-- Logs begin at Wed 2022-07-27 03:15:15 UTC, end at Wed 2022-07-27 04:34:18 UTC. -- Jul 27 04:03:34.804122 dv-cinder-850989-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 04:03:34.812829 dv-cinder-850989-2-smb devstack@keystone.service[80340]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 04:03:34 2022] *** Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: nodename: dv-cinder-850989-2-smb Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: machine: x86_64 Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: clock source: unix Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: pcre jit disabled Jul 27 04:03:34.814850 dv-cinder-850989-2-smb devstack@keystone.service[80340]: detected number of CPU cores: 4 Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: current working directory: / Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: detected binary path: /usr/bin/uwsgi-core Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: your processes number limit is 47680 Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: your memory page size is 4096 bytes Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: detected max file descriptor number: 2048 Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: lock engine: pthread robust mutexes Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: thunder lock: enabled Jul 27 04:03:34.815323 dv-cinder-850989-2-smb devstack@keystone.service[80340]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 04:03:34.818238 dv-cinder-850989-2-smb devstack@keystone.service[80340]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 04:03:34.856350 dv-cinder-850989-2-smb devstack@keystone.service[80340]: Python main interpreter initialized at 0x562092f749c0 Jul 27 04:03:34.856350 dv-cinder-850989-2-smb devstack@keystone.service[80340]: python threads support enabled Jul 27 04:03:34.856350 dv-cinder-850989-2-smb devstack@keystone.service[80340]: your server socket listen backlog is limited to 100 connections Jul 27 04:03:34.856350 dv-cinder-850989-2-smb devstack@keystone.service[80340]: your mercy for graceful operations on workers is 90 seconds Jul 27 04:03:34.856717 dv-cinder-850989-2-smb devstack@keystone.service[80340]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 04:03:34.856819 dv-cinder-850989-2-smb devstack@keystone.service[80340]: *** Operational MODE: preforking *** Jul 27 04:03:34.857093 dv-cinder-850989-2-smb devstack@keystone.service[80340]: *** uWSGI is running in multiple interpreter mode *** Jul 27 04:03:34.857093 dv-cinder-850989-2-smb devstack@keystone.service[80340]: spawned uWSGI master process (pid: 80340) Jul 27 04:03:34.857296 dv-cinder-850989-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 04:03:34.858231 dv-cinder-850989-2-smb devstack@keystone.service[80340]: spawned uWSGI worker 1 (pid: 80351, cores: 1) Jul 27 04:03:34.858231 dv-cinder-850989-2-smb devstack@keystone.service[80340]: spawned uWSGI worker 2 (pid: 80352, cores: 1) Jul 27 04:03:34.858368 dv-cinder-850989-2-smb devstack@keystone.service[80340]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 04:03:40.398262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:03:40.398262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: from cryptography.utils import int_from_bytes Jul 27 04:03:40.399609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:03:40.399609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: from cryptography.utils import int_from_bytes Jul 27 04:03:40.449492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 04:03:40.449686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 04:03:40.449881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] command line args: [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 04:03:40.450151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 04:03:40.450328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ================================================================================ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 04:03:40.450580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] admin_token = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.450826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config_dir = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.451013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.451195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] config_source = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.451399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] debug = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.451597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_config_append = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_dir = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.453953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.454198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.454442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.454620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.454797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.455040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.455303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.455542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.455774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.456007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.456239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.456482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.456725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.456999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.457491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.457671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] publish_errors = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.457903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.458133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.458310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.458553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.458786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.459019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] standard_threads = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.459248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.459518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.459693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.459867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_journal = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.460043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_json = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.460217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_stderr = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.460390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] use_syslog = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.460617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.460868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.461107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.461366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.462498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.462498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.462784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.462999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.463242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.463517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.463766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.464015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.464250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.464498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.464733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.464980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.465226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.465461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.465714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.465968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.466213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.466451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.466703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.466964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.467215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.467489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.467721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.468008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.468180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.468414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.468662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.468909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.469139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.469369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.469615 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.469861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.470096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.470342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.470573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.470809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.471042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.471287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.471523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.471753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.471982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.472218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.472464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.472695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.472930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.473167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.473400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.473634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.473882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.474112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.474348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.474583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.474818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.475054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.475319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.475551 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.475799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.476034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.476269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.476498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.476756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.476990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.477890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.478302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.478302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.478523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.478762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.479009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.479253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.479509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.479743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.479978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.480222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.480460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.480696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.480936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.481169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.481405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.481638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.481872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.482106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.482365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.482603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.482843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.483085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.483356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.483595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.483831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.484066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.484297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.484528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.484758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.484995 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.485229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.485470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.485706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.485953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.486199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.486454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.486715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.486955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.487188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.external = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.487442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.487739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.487973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.488207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.password = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.488440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] auth.token = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.488680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.488917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.489162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.489394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.489641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.489889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.490120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.490355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.490600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.490681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:03:40.490681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: from cryptography.utils import int_from_bytes Jul 27 04:03:40.491178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.491251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 04:03:40.491251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: from cryptography.utils import int_from_bytes Jul 27 04:03:40.491452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.491452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.491584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.491785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.492055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.492310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.492547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.492939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.493417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.493676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.493955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.494204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.494466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.494706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.494946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.495195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.495471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.495708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.495957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.496196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.496451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.496689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.496944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.497182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.497548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.497795 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.498047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.498297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.498534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.498770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.499019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.499251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.499512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.499764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.500015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.500248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.500479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.500710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.500953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.501200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.501456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.501709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.501955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.502341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.502465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.502685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.502916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.503159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.503417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.503652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.503893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.504133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.504384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.504618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.504867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.505116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.505351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.505598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.505847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.506078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.506317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.506547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.506785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.507023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.507290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.507520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.507757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.508008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.508255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.508616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.508867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.509122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.509373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.509608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.509845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.510080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.510578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.510818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.511077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.511330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.511583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.511833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.512081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.512315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.512547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.512781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.513016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.513261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.513493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.513742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.513990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.514238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.514607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.514858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.515091 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.515359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.515601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.515839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.516076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.516313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.516560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.516810 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.517049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.517305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.517537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.517781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.518018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.518253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.518490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.518737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.518979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.519211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.519469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.519709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.519960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.520207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.520445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.520696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.520947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.521181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.521428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.521666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.521906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.522141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.522388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.522619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.522869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.523123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.523396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.523645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.523894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.524664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.524909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.525157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.525388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.525635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.525883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.526130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.526377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.526802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.527040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.527309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.527563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.527826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.528074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.528294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.528546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.528798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.529037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.529268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.529499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.529730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.529981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.530234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.530481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.530716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.530951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.531180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.531437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.531674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.531924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.532161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.532420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.532667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.532905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.533150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.533391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.533644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.533880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.534120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.534354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.534601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.534849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.535078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.535368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.535664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.535924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.536169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.536416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.536656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.536896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.537131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.537368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.537603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.537838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.538082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.538318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.538495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 04:03:40.538580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.538693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 04:03:40.538774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.538889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] command line args: [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 04:03:40.539016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.539163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 04:03:40.539245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.539374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ================================================================================ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 04:03:40.539506 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.540221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] admin_token = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.540360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.540490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_dir = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.540561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.540629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.540741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.540812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] config_source = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.540969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 04:03:40.541117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] debug = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.541245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.541399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.541567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.541832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.542090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.542327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.542511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_config_append = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.542692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.542872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_dir = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.543093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.543301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.543557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.543809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.544059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.544241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.544422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.544668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.544915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.545153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.545389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.545628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.545864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.546114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.546363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.546639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.547141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.547349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] publish_errors = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.547587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.547820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.548001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.548251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.548489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.548726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] standard_threads = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.548963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.549210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.549389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.549567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_journal = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.549746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_json = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.549924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_stderr = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.550103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] use_syslog = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.550338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 04:03:40.550598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.550843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.551109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.551378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.551636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.551883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.552137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.552381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.552635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.552890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.553144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.553385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.553640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.553883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.554139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.554396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.554640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.554903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.555166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.555552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.555552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.556014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.556284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.556546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.556803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.557049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.557288 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.557525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.557765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.558021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.558284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.558522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.558761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.559014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.559284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.559535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.559792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.560031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.560274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.560516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.560754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.560992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.561228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.561465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.561708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.561962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.562198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.562441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.562678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.562920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.563160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.563506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.563746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.563991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.564233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.564475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.564717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.564959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.565195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.565449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.565688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.565929 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.566168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.566434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.566678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.566919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.567164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.567431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.567704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.567978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.568197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.568446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.568688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.568930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.569172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.569252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.569425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.569504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.569668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.569750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.569911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.570157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.570400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.570642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.571515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.571937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.572365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.572823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.573084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.573337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.573587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.573838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.574085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.574331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.574577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.574818 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.575057 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.575317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.575563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.575806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.576052 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.576307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.576566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.576812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.577074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.577341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.577594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.577835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.external = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.578073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.578376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.578456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.578616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.578856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.password = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.579094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] auth.token = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.579366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.579611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.579865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.580104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.580359 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.580615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.580853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.581095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.581350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.581604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.581860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.582104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.582354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.582594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.582869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.583131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.583399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.583661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.583952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.584204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.584473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.584721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.584986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.585229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.585475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.585728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.585983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.586222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.586565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.586812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.587073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.587364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.587626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.587874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.588129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.588373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.588628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.588881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.589124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.589365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.589620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.589858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.590104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.590360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.590618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.590857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.591095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.591361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.591612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.591866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.592121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.592383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.592636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.592923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.593168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.593411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.593649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.593893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.594129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.594383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.594629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.594875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.595132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.595397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.595653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.595906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.596148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.596401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.596656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.596893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.597136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.597379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.597623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.597868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.598114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.598357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.598602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.598859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.599114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.599381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.599623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.599881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.600134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.600377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.600620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.600860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.601099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.601346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.601613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.601852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.602676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.603238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.603238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.603519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.603688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.603932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.604172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.604417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.604656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.604912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.605167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.605420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.605673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.605928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.606166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.606420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.606664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.606908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.607151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.607418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.607670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.607930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.608176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.608317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.608446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.608571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.608696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.608898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.609141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.609382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.609754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.610012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.610263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.610506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.610750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.610998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.611276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.611533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.611777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.612035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.612292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.612534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.612789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.613035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.613282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.613524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.613779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.614017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.614274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.614529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.614785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.615039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.615318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.615574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.615827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.616082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.616321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.616576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.616829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.617082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.617336 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.618421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.618855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.618934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.619125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.619407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.619666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.619908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.620171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.620431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.620683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.620925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.621165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.621406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.621665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.621927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.622183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.622427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.622670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.622908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.623151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.623421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.623678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.623921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.624187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.624442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.624686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.624938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.625185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.625437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.625682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.625928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.626168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.626421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.626676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.626912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.627160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.627482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.627754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.628006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.628259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.628504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.628750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.628992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.629234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.629475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.629719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.629969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.630210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.630458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.630699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.630952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.631195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.631474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.631713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.631959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.632210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 04:03:40.632383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 04:03:40.657137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.657339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.657535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.660229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.666636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.686679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.686915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.710650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.710885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.724139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.761986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.762227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.776382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.776614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.776837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.777055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.777271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.777486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.800197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.800543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.800775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.800995 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.801211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.801424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.801637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.803809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.804046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.804271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.804494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.804733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.804955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.812741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.817861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.818096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.818322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.818545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.818766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.818987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.819202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.826086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.826324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.826549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.826774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.826989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.827201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.827384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.827477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.830449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.830684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.830913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.831136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.831381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.831600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.831817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 04:03:40.844011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.844219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 04:03:40.844546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.844742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 04:03:40.844951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.845045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.845171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 04:03:40.845288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.845484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.845572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.845696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 04:03:40.845781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.845969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.846230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.846488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.846745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.856006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.856277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.856540 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.856815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.857049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.857327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.857599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.857891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.863670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.864934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.868636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.868913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.869188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.869460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.869733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.869830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.869986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.870071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.870247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.870330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.870512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.870596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.870773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.870855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.871037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.871127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.871318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.871406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.871672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.871953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.872245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.872513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.894793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.896289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.896566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.896909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.898480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.898839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.901943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.902224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.902503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.904344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.904697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.905068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.909150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.909381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.912008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.912362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.913434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.913718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.914008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.914282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.914562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.914874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.915148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.915453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.917128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.917128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.917453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.917735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.918009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.918283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.918559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.918827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.932019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.932294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.935156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.935460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.936271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.939393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.939490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.939686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.942515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.942820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.944026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.947879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.947978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.951039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.951145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.951354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.951637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.951927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.952211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.952495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.954242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.954540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.954833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.955118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.955418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.955706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.968477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.968767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.969027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.969281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.971645 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.971932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.972198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.972460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.976096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.977650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.977917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.979295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.980708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.980843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.980978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.981130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.981265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.981533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.981809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.983868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.984146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.984432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.984727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.985007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.993635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.993904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.994176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.994448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.994721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.994988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.995254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.996973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:40.997255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.997535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.997815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.998093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.998362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:40.998649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.011206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.014143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.014423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.017093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.017391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.019544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.020352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.021047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.021329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.021606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.022803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.024830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.025114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.025401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.028761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.030349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.031957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.033274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.033559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.033642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.033839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.034117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.036479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.036767 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.037050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.037332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.042124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.042408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.042685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.045747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.046035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.046312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.049499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.049776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.050052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.050321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.050587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.050863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.051142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.051451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.051819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.052093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.052367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.052626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.052895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.053140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 04:03:41.053224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.053420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.053700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.053975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.054254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.054532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.054813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.055080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.056050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.056503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.056787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.057060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.057333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.057593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 04:03:41.087415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562092f749c0 pid: 80351 (default app) Jul 27 04:03:41.090657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30b99-4aba-4263-9810-c32ed6bac3e9 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:41.090941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30b99-4aba-4263-9810-c32ed6bac3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:41.091212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30b99-4aba-4263-9810-c32ed6bac3e9 None None] PATH_INFO: `/v3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:41.092364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562092f749c0 pid: 80352 (default app) Jul 27 04:03:41.095567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Wed Jul 27 04:03:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:48.702563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ed25-7db4-4768-9561-eb50ef1360bc None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:48.703149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ed25-7db4-4768-9561-eb50ef1360bc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:48.703149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ed25-7db4-4768-9561-eb50ef1360bc None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:48.707560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:03:48.712930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:48.713350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:48.713471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:48.783762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: INFO dbcounter [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] Registered counter for database keystone Jul 27 04:03:48.805079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG oslo_db.sqlalchemy.engines [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:03:48.811718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writer thread running {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:03:48.988672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG passlib.handlers.bcrypt [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 04:03:48.989003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG passlib.handlers.bcrypt [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 04:03:49.043443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:49.045053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:49.167670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 04:03:49.315317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ed25-7db4-4768-9561-eb50ef1360bc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:49.384227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: INFO dbcounter [None req-23b9ed25-7db4-4768-9561-eb50ef1360bc None None] Registered counter for database keystone Jul 27 04:03:49.403418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG oslo_db.sqlalchemy.engines [None req-23b9ed25-7db4-4768-9561-eb50ef1360bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 04:03:49.409513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writer thread running {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 04:03:49.527697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ed25-7db4-4768-9561-eb50ef1360bc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:49.531960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f7c97-7c00-45d6-98c2-62af6766acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:49.532591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7c97-7c00-45d6-98c2-62af6766acf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:49.532873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7c97-7c00-45d6-98c2-62af6766acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:49.533148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f7c97-7c00-45d6-98c2-62af6766acf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:49.541927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f7c97-7c00-45d6-98c2-62af6766acf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:49.592741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d18f7c97-7c00-45d6-98c2-62af6766acf9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 04:03:49.593035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f7c97-7c00-45d6-98c2-62af6766acf9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:49.603007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Jul 27 04:03:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 04:03:49.609077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:49.624025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e71e1-b398-4612-a0be-011cda91cd9e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:49.628401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2e1cf-269e-493c-80e1-0bd94736ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:49.629497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2e1cf-269e-493c-80e1-0bd94736ab4a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:49.629775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2e1cf-269e-493c-80e1-0bd94736ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:49.630044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2e1cf-269e-493c-80e1-0bd94736ab4a admin admin] PATH_INFO: `/v3/projects/fe087670259b408d800e85991f04fa29` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:49.631557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2e1cf-269e-493c-80e1-0bd94736ab4a admin admin] RBAC: Authorizing `identity:get_project(project_id=fe087670259b408d800e85991f04fa29)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:49.682464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49d2e1cf-269e-493c-80e1-0bd94736ab4a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 04:03:49.682803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2e1cf-269e-493c-80e1-0bd94736ab4a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:49.687553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Wed Jul 27 04:03:49 2022] GET /identity/v3/projects/fe087670259b408d800e85991f04fa29 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:51.656456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5d50-0e47-4b5c-b0b0-6f0b49a5d308 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:51.657000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5d50-0e47-4b5c-b0b0-6f0b49a5d308 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:51.657000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5d50-0e47-4b5c-b0b0-6f0b49a5d308 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:51.661154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:03:51.666587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a25d59-0bf2-484b-b575-7d727e026bb2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:51.667029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a25d59-0bf2-484b-b575-7d727e026bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:51.667149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a25d59-0bf2-484b-b575-7d727e026bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:51.687251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-21a25d59-0bf2-484b-b575-7d727e026bb2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:51.688915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-21a25d59-0bf2-484b-b575-7d727e026bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:51.697318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 04:03:51.718675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5d50-0e47-4b5c-b0b0-6f0b49a5d308 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:51.730735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e5d50-0e47-4b5c-b0b0-6f0b49a5d308 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:51.734918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bf0cd-15a6-4793-aa50-4fcf8490fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:51.735551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0cd-15a6-4793-aa50-4fcf8490fcce admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:51.735833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0cd-15a6-4793-aa50-4fcf8490fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:51.736107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0cd-15a6-4793-aa50-4fcf8490fcce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:51.744831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bf0cd-15a6-4793-aa50-4fcf8490fcce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:51.746235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bf0cd-15a6-4793-aa50-4fcf8490fcce admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:51.754860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Jul 27 04:03:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:03:51.761404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a25d59-0bf2-484b-b575-7d727e026bb2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:51.770492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a25d59-0bf2-484b-b575-7d727e026bb2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:51.775126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559ef3a-df8a-4852-b8bc-4e4ef6b56fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:51.775793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ef3a-df8a-4852-b8bc-4e4ef6b56fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:51.776079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ef3a-df8a-4852-b8bc-4e4ef6b56fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:51.776355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ef3a-df8a-4852-b8bc-4e4ef6b56fd6 admin admin] PATH_INFO: `/v3/users/7081d973c3644a09a5c8eaa060094b63` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:51.777734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559ef3a-df8a-4852-b8bc-4e4ef6b56fd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=7081d973c3644a09a5c8eaa060094b63)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:51.779639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559ef3a-df8a-4852-b8bc-4e4ef6b56fd6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:51.781186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Wed Jul 27 04:03:51 2022] GET /identity/v3/users/7081d973c3644a09a5c8eaa060094b63 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:53.827533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181919-1ab0-4dde-83fa-edb65647deab None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:53.828068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181919-1ab0-4dde-83fa-edb65647deab None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:53.828068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181919-1ab0-4dde-83fa-edb65647deab None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:53.829433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:03:53.834525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce339edf-f77c-4bee-bfe3-c5a5f1f6fa63 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:53.834902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce339edf-f77c-4bee-bfe3-c5a5f1f6fa63 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:53.835095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce339edf-f77c-4bee-bfe3-c5a5f1f6fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:53.855246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ce339edf-f77c-4bee-bfe3-c5a5f1f6fa63 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:53.856473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ce339edf-f77c-4bee-bfe3-c5a5f1f6fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:53.876186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eeb6f-58d3-4c64-97bc-383a3d30f5d7 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:53.876473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eeb6f-58d3-4c64-97bc-383a3d30f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:53.876748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eeb6f-58d3-4c64-97bc-383a3d30f5d7 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:53.878088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:03:53.883020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:53.883358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:53.883720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:53.925726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG passlib.handlers.bcrypt [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80352) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 04:03:53.926154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG passlib.handlers.bcrypt [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80352) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 04:03:53.936413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:03:53.958899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce339edf-f77c-4bee-bfe3-c5a5f1f6fa63 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:53.972186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:53.973765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:53.982505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:54.062831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce339edf-f77c-4bee-bfe3-c5a5f1f6fa63 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.074683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:03:54.096980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:54.098760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.098760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.098999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.099295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.111138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:03:54.119919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:03:54.120837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:03:54.121682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:03:54.126910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:54.196598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175bc44-8902-4c3a-9096-8fbe23f0f88d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.199020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:54.206280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:54.225144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889ec3-ae81-4335-8ced-f0054805d041 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.233436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.234311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.234605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.234885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.258050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.259403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.259690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.259966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.260942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:03:54.261246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:54.262642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:54.274594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:03:54.280163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:54.302701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:54.304276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:54.382968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a50fd-505c-4f2d-865a-9e080fcaeb29 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.403762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:03:54.409562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:54.412757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:54.513853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a90e-1b4b-4694-bb8c-9c6d88d2c7cf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.523628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.524486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.524775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.525052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] PATH_INFO: `/v3/users/7081d973c3644a09a5c8eaa060094b63` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.526232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] RBAC: Authorizing `identity:get_user(user_id=7081d973c3644a09a5c8eaa060094b63)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:54.527758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:54.529340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:03:54 2022] GET /identity/v3/users/7081d973c3644a09a5c8eaa060094b63 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:03:54.534667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:54.549284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:54.549564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.550562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.550692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.550988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.569711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:54.571930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:03:54.589581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:03:54.590490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:03:54.591352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:03:54.591352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:03:54.591352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:03:54.591352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:03:54.591352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:03:54.596817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:54.635139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be7dcb-0328-4612-acc6-9c3fa479b605 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.653853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:54.668088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.668730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.669010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.669284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.670442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:54.671932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:54.673513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:54.679125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:54.698579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1216-b717-4bd4-93c7-f25b909267ae None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.732183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d779d-bf00-406f-8692-36dedbdc3e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.732804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d779d-bf00-406f-8692-36dedbdc3e34 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.733087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d779d-bf00-406f-8692-36dedbdc3e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.733362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d779d-bf00-406f-8692-36dedbdc3e34 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.734065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d779d-bf00-406f-8692-36dedbdc3e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:03:54.734375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d779d-bf00-406f-8692-36dedbdc3e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:54.735807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d779d-bf00-406f-8692-36dedbdc3e34 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:54.753582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:03:54.767640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:54.788531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7982a-6f56-4e9d-81a9-6640bc859787 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:54.825499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafbfd8-7798-4388-ab70-48e0ef9f7721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:54.826138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbfd8-7798-4388-ab70-48e0ef9f7721 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:54.826427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbfd8-7798-4388-ab70-48e0ef9f7721 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:54.826707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbfd8-7798-4388-ab70-48e0ef9f7721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:54.827552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafbfd8-7798-4388-ab70-48e0ef9f7721 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.domain.id=default, user.id=7081d973c3644a09a5c8eaa060094b63) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:03:54.827871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafbfd8-7798-4388-ab70-48e0ef9f7721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:54.829362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafbfd8-7798-4388-ab70-48e0ef9f7721 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:54.837196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Jul 27 04:03:54 2022] GET /identity/v3/role_assignments?user.id=7081d973c3644a09a5c8eaa060094b63&scope.domain.id=default&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:03:57.322711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b7e9-2d18-47b0-a43c-99eb47130190 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:57.323279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b7e9-2d18-47b0-a43c-99eb47130190 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:57.323279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b7e9-2d18-47b0-a43c-99eb47130190 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:57.324831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:03:57.330045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcd4cd-a54e-4963-bc01-f8555cd49ecc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:57.330464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcd4cd-a54e-4963-bc01-f8555cd49ecc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:57.330629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcd4cd-a54e-4963-bc01-f8555cd49ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:57.357097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5dbcd4cd-a54e-4963-bc01-f8555cd49ecc None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:57.358288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5dbcd4cd-a54e-4963-bc01-f8555cd49ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:57.458524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:03:57.461474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2961d-d125-46b4-96a4-ba3056d2da3a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:57.462026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2961d-d125-46b4-96a4-ba3056d2da3a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:57.462501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2961d-d125-46b4-96a4-ba3056d2da3a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:57.464093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:03:57.469402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3ec0c-c15d-4538-bdea-2a8d6ac689fd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:57.469693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3ec0c-c15d-4538-bdea-2a8d6ac689fd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:57.469971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3ec0c-c15d-4538-bdea-2a8d6ac689fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:57.496244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fcd3ec0c-c15d-4538-bdea-2a8d6ac689fd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:57.497421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fcd3ec0c-c15d-4538-bdea-2a8d6ac689fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:57.535181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2961d-d125-46b4-96a4-ba3056d2da3a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:57.597841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:03:57.646508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3ec0c-c15d-4538-bdea-2a8d6ac689fd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:57.650784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:57.693418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2961d-d125-46b4-96a4-ba3056d2da3a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:57.713737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:57.761750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:57.762625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:57.763042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:57.763681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:57.784537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:03:57.793435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:03:57.794495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:03:57.795473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:03:57.796624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:03:57.816659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:57.842842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3ec0c-c15d-4538-bdea-2a8d6ac689fd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:57.881272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14bda-bd35-40bc-8e7e-ed9d4aaca854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:57.882225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14bda-bd35-40bc-8e7e-ed9d4aaca854 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:57.882717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14bda-bd35-40bc-8e7e-ed9d4aaca854 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:57.883210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14bda-bd35-40bc-8e7e-ed9d4aaca854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:57.896779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14bda-bd35-40bc-8e7e-ed9d4aaca854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:57.898776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14bda-bd35-40bc-8e7e-ed9d4aaca854 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-9df14bda-bd35-40bc-8e7e-ed9d4aaca854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:03:57.926294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:03:57.927195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:03:57.928040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:03:57.928040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:03:57.928040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:03:57.928040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:03:57.928040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:03:57.931839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90280b3-b62b-463a-be8e-8b4052635109 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:57.935076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90280b3-b62b-463a-be8e-8b4052635109 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:57.935742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90280b3-b62b-463a-be8e-8b4052635109 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:57.938197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 15/28] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:03:57.942718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90280b3-b62b-463a-be8e-8b4052635109 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:58.030594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f307fe-1eb5-448a-859b-b5cd2f66f5fa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:58.045827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:58.075654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14265df-46f2-4b46-b3f5-ae556f105cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:58.076551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14265df-46f2-4b46-b3f5-ae556f105cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.076971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14265df-46f2-4b46-b3f5-ae556f105cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.077385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14265df-46f2-4b46-b3f5-ae556f105cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.078241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14265df-46f2-4b46-b3f5-ae556f105cf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:03:58.078701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14265df-46f2-4b46-b3f5-ae556f105cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:58.080254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14265df-46f2-4b46-b3f5-ae556f105cf4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:58.093924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 14/29] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:03:58.095393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079e8a-2e17-483c-ac20-945fa7e5b6b7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.095805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079e8a-2e17-483c-ac20-945fa7e5b6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.096200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079e8a-2e17-483c-ac20-945fa7e5b6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.102597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90280b3-b62b-463a-be8e-8b4052635109 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:58.145186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:58.146169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.146666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.147160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.148119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:03:58.148654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:58.150944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:58.172736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:58.174126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:58.229717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b0079e8a-2e17-483c-ac20-945fa7e5b6b7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:58.231045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b0079e8a-2e17-483c-ac20-945fa7e5b6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:58.264017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:58.296075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4136c50-d1b8-46a9-a735-1b4a6fabe05d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:58.312359 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:03:58.314358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244406b-52a9-4144-85dc-f1309d6ae00d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.314649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244406b-52a9-4144-85dc-f1309d6ae00d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.314923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244406b-52a9-4144-85dc-f1309d6ae00d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.316778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:58.317298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 16/32] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:03:58.318428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244406b-52a9-4144-85dc-f1309d6ae00d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:58.350638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc082c3-3b93-405c-abc1-b84ec096f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:58.351484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc082c3-3b93-405c-abc1-b84ec096f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.351917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc082c3-3b93-405c-abc1-b84ec096f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.352892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc082c3-3b93-405c-abc1-b84ec096f6a5 None admin] PATH_INFO: `/v3/users/7081d973c3644a09a5c8eaa060094b63` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.354626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc082c3-3b93-405c-abc1-b84ec096f6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=7081d973c3644a09a5c8eaa060094b63)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:58.356294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc082c3-3b93-405c-abc1-b84ec096f6a5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:58.358530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 17/33] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:03:58 2022] GET /identity/v3/users/7081d973c3644a09a5c8eaa060094b63 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:58.360245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5a44-b3f0-4145-a10b-cf434301740e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.360878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5a44-b3f0-4145-a10b-cf434301740e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.361294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5a44-b3f0-4145-a10b-cf434301740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.383898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e9bd5a44-b3f0-4145-a10b-cf434301740e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:58.385748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e9bd5a44-b3f0-4145-a10b-cf434301740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:58.448492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244406b-52a9-4144-85dc-f1309d6ae00d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:58.469825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:03:58.479499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd5a44-b3f0-4145-a10b-cf434301740e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:58.503493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:58.504120 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.504398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.504677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.505601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:58.507053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:58.575062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd5a44-b3f0-4145-a10b-cf434301740e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:58.589742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:58.610422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59bd3-394a-4924-8172-047afd884748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:58.611045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59bd3-394a-4924-8172-047afd884748 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.611354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59bd3-394a-4924-8172-047afd884748 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.611629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59bd3-394a-4924-8172-047afd884748 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.612345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b59bd3-394a-4924-8172-047afd884748 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:58.613723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b59bd3-394a-4924-8172-047afd884748 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:58.659295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 17/35] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:03:58 2022] POST /identity/v3/projects => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:03:58.659295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:58.686427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:58.736236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 19/36] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 04:03:58 2022] POST /identity/v3/roles => generated 219 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:03:58.737780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6fff-4b08-494d-ba21-2793881ef25e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.738078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6fff-4b08-494d-ba21-2793881ef25e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.738362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6fff-4b08-494d-ba21-2793881ef25e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.747245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 20/37] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:03:58.747245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd6fff-4b08-494d-ba21-2793881ef25e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:58.819853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc2814-07d7-4c8e-9de3-949ed28f420a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:58.863988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b287a-126b-4a19-8c8e-f3ba95ce4636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:58.864795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b287a-126b-4a19-8c8e-f3ba95ce4636 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.865086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b287a-126b-4a19-8c8e-f3ba95ce4636 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.865365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b287a-126b-4a19-8c8e-f3ba95ce4636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.866686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b287a-126b-4a19-8c8e-f3ba95ce4636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:58.868556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b287a-126b-4a19-8c8e-f3ba95ce4636 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:58.871333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 18/38] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:03:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:58.872722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e927-4d6a-4124-b45d-d440b69387a6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.873134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e927-4d6a-4124-b45d-d440b69387a6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.873417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e927-4d6a-4124-b45d-d440b69387a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.894897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dc55e927-4d6a-4124-b45d-d440b69387a6 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:58.896529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dc55e927-4d6a-4124-b45d-d440b69387a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:58.898277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd6fff-4b08-494d-ba21-2793881ef25e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:58.942773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d639932-809f-463d-b936-2006eebd560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:58.943448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639932-809f-463d-b936-2006eebd560f None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.943739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639932-809f-463d-b936-2006eebd560f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.944020 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639932-809f-463d-b936-2006eebd560f None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.944811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d639932-809f-463d-b936-2006eebd560f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:58.947131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d639932-809f-463d-b936-2006eebd560f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:58.965938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 21/39] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 04:03:58 2022] POST /identity/v3/roles => generated 225 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:03:58.967665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff201d7b-4004-4154-b029-fe7fcb4496ee None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.968220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff201d7b-4004-4154-b029-fe7fcb4496ee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.969449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff201d7b-4004-4154-b029-fe7fcb4496ee None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:58.970847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 22/40] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:03:58.971634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff201d7b-4004-4154-b029-fe7fcb4496ee None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:58.977981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 19/41] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:03:58.979734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9682c-1a4c-4d12-a4a2-6e06a938c92a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:58.980249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9682c-1a4c-4d12-a4a2-6e06a938c92a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:58.980780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9682c-1a4c-4d12-a4a2-6e06a938c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:59.002882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0df9682c-1a4c-4d12-a4a2-6e06a938c92a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:03:59.004478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0df9682c-1a4c-4d12-a4a2-6e06a938c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:03:59.018309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:59.021109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:59.091517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 20/42] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:03:59.093133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9682c-1a4c-4d12-a4a2-6e06a938c92a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:59.099440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff201d7b-4004-4154-b029-fe7fcb4496ee None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:59.142598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:59.143427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:59.143718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:59.143994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] PATH_INFO: `/v3/domains/default/users/7081d973c3644a09a5c8eaa060094b63/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:59.146457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7081d973c3644a09a5c8eaa060094b63, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:59.147993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:59.169382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1361 bytes} [Wed Jul 27 04:03:58 2022] PUT /identity/v3/domains/default/users/7081d973c3644a09a5c8eaa060094b63/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:03:59.169984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:59.237932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9682c-1a4c-4d12-a4a2-6e06a938c92a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:59.279821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:59.280574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:59.280865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:59.281149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:59.282357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:59.284308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:59.286217 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 21/44] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:03:59.290635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:59.293249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:03:59.302090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bbf12-3138-4f13-bc9d-a260e120f0dd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:59.314425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:03:59.342721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87dcf-dc1b-4557-9aaf-745b7289cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:59.343437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87dcf-dc1b-4557-9aaf-745b7289cbbb None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:59.343725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87dcf-dc1b-4557-9aaf-745b7289cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:59.344004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87dcf-dc1b-4557-9aaf-745b7289cbbb None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:59.344728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87dcf-dc1b-4557-9aaf-745b7289cbbb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:59.346139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87dcf-dc1b-4557-9aaf-745b7289cbbb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:59.362671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 24/45] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 04:03:59 2022] POST /identity/v3/roles => generated 223 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:03:59.420804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea784-33a8-4c0f-a24a-6b769fdfa5d0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:03:59.461314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0e3b7-cdb0-4da2-a6c9-749e8cbd9c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:03:59.462750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0e3b7-cdb0-4da2-a6c9-749e8cbd9c8a None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:03:59.463006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0e3b7-cdb0-4da2-a6c9-749e8cbd9c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:03:59.463314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0e3b7-cdb0-4da2-a6c9-749e8cbd9c8a None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:03:59.464027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0e3b7-cdb0-4da2-a6c9-749e8cbd9c8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:03:59.465514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0e3b7-cdb0-4da2-a6c9-749e8cbd9c8a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:03:59.496371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:03:59 2022] POST /identity/v3/projects => generated 312 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:01.238318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7585-6b32-4980-a4b1-ecc0ac9e5925 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.238838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7585-6b32-4980-a4b1-ecc0ac9e5925 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.238921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7585-6b32-4980-a4b1-ecc0ac9e5925 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.240282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:01.246090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56417-6a60-4bdc-8b4c-6fd586163dee None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.246495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56417-6a60-4bdc-8b4c-6fd586163dee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.246661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56417-6a60-4bdc-8b4c-6fd586163dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.265774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-82d56417-6a60-4bdc-8b4c-6fd586163dee None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:01.266958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-82d56417-6a60-4bdc-8b4c-6fd586163dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:01.327801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:01.333892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:01.356445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb7585-6b32-4980-a4b1-ecc0ac9e5925 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:01.457715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb7585-6b32-4980-a4b1-ecc0ac9e5925 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:01.482053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6ebb-15a5-40e6-930b-7d0ddea55270 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.482346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6ebb-15a5-40e6-930b-7d0ddea55270 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.482644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6ebb-15a5-40e6-930b-7d0ddea55270 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.484050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 24/49] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:01.488846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7ac2-10fe-425a-96f5-9588c6c47bcc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.489173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7ac2-10fe-425a-96f5-9588c6c47bcc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.489526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7ac2-10fe-425a-96f5-9588c6c47bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.491143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:01.491810 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.492094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.492366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.503497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:01.508942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:01.509917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:01.510953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:01.511659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-676c7ac2-10fe-425a-96f5-9588c6c47bcc None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:01.511738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 26/50] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:01.511816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-676c7ac2-10fe-425a-96f5-9588c6c47bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:01.516311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:01.532503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:01.579023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 25/51] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:01.601100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7ac2-10fe-425a-96f5-9588c6c47bcc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:01.616989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a667c-2386-439f-bc64-cf418c662c82 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:01.650174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:01.650790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.651075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.651379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.652088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:01.652396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:01.653777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:01.661743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:01.668028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:01.700253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7ac2-10fe-425a-96f5-9588c6c47bcc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:01.726917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:01.735785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:01.736431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.736718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.736998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.738224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:01.739782 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:01.741584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:01.745610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:01.748205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:01.768853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b99e9-4080-4af5-adfe-30ce20332a8d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:01.802383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:01.803023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.803331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.803609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] PATH_INFO: `/v3/users/7081d973c3644a09a5c8eaa060094b63` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.804781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] RBAC: Authorizing `identity:get_user(user_id=7081d973c3644a09a5c8eaa060094b63)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:01.806871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:01.808494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:01 2022] GET /identity/v3/users/7081d973c3644a09a5c8eaa060094b63 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:01.813731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:01.849802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd3531-a0b8-4998-bca7-b7dc1f1dedff None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:01.884399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:01.885018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.885550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.885837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.886535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:01.888024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:01.911597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b671-8ba8-414b-99ab-b8d6b6b65a95 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:01.914506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 27/55] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Jul 27 04:04:01 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:04:01.949469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aa8a4-ee7f-40fe-8a13-b1363d67e985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:01.950139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa8a4-ee7f-40fe-8a13-b1363d67e985 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:01.950423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa8a4-ee7f-40fe-8a13-b1363d67e985 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:01.950704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa8a4-ee7f-40fe-8a13-b1363d67e985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:01.951998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aa8a4-ee7f-40fe-8a13-b1363d67e985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:01.953495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aa8a4-ee7f-40fe-8a13-b1363d67e985 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:01.955137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:01.961377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:02.015245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:02.068999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867394-7b64-4c31-98a9-b42a762f27bd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:02.103726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176e8c-ffa7-4286-bcdd-b58b4d63901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:02.104352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176e8c-ffa7-4286-bcdd-b58b4d63901a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:02.104642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176e8c-ffa7-4286-bcdd-b58b4d63901a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:02.104927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176e8c-ffa7-4286-bcdd-b58b4d63901a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:02.105727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176e8c-ffa7-4286-bcdd-b58b4d63901a None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.domain.id=default, user.id=7081d973c3644a09a5c8eaa060094b63) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:02.106041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176e8c-ffa7-4286-bcdd-b58b4d63901a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:02.107524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176e8c-ffa7-4286-bcdd-b58b4d63901a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:02.116694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Jul 27 04:04:01 2022] GET /identity/v3/role_assignments?user.id=7081d973c3644a09a5c8eaa060094b63&scope.domain.id=default&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:03.934547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482ea2-f829-44e7-8629-d4302a887f81 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:03.935054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482ea2-f829-44e7-8629-d4302a887f81 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:03.935137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482ea2-f829-44e7-8629-d4302a887f81 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:03.936502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:03.941551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a051e6-a7c8-4176-9ef6-44f78a99599a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:03.941919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a051e6-a7c8-4176-9ef6-44f78a99599a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:03.942112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a051e6-a7c8-4176-9ef6-44f78a99599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:03.960766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-17a051e6-a7c8-4176-9ef6-44f78a99599a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:03.962550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-17a051e6-a7c8-4176-9ef6-44f78a99599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:04.029207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:04.052828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f482ea2-f829-44e7-8629-d4302a887f81 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:04.067831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:04.154594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f482ea2-f829-44e7-8629-d4302a887f81 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:04.186721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299b61e-4954-4228-898f-ca8cd972c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:04.187382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299b61e-4954-4228-898f-ca8cd972c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:04.187663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299b61e-4954-4228-898f-ca8cd972c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:04.187936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299b61e-4954-4228-898f-ca8cd972c5c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:04.189070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299b61e-4954-4228-898f-ca8cd972c5c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:04.190518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299b61e-4954-4228-898f-ca8cd972c5c3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:04.192103 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:04.198411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a051e6-a7c8-4176-9ef6-44f78a99599a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:04.239788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:04.294944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a051e6-a7c8-4176-9ef6-44f78a99599a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:04.327525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc867d-da61-4175-b761-41fbacc5e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:04.328133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc867d-da61-4175-b761-41fbacc5e232 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:04.328415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc867d-da61-4175-b761-41fbacc5e232 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:04.328691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc867d-da61-4175-b761-41fbacc5e232 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:04.329363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc867d-da61-4175-b761-41fbacc5e232 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:04.330801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc867d-da61-4175-b761-41fbacc5e232 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:04.357775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:04 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:07.628384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc887119-7a09-4698-bbde-1cbecb385af5 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.628900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc887119-7a09-4698-bbde-1cbecb385af5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.629011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc887119-7a09-4698-bbde-1cbecb385af5 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.630640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:07.637737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6935378-0722-48e8-ad83-76750fe90b0f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.638165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6935378-0722-48e8-ad83-76750fe90b0f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.638338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6935378-0722-48e8-ad83-76750fe90b0f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.641304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f453c-16ba-4db0-9bea-717241c2c936 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.641600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f453c-16ba-4db0-9bea-717241c2c936 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.641880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f453c-16ba-4db0-9bea-717241c2c936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.642042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:07.647246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fde4-7d7f-4f8f-8bbc-a8ab18b379c3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.647574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fde4-7d7f-4f8f-8bbc-a8ab18b379c3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.647860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fde4-7d7f-4f8f-8bbc-a8ab18b379c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.676771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9b2f453c-16ba-4db0-9bea-717241c2c936 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:07.678327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9b2f453c-16ba-4db0-9bea-717241c2c936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:07.684921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b6f3fde4-7d7f-4f8f-8bbc-a8ab18b379c3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:07.686106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b6f3fde4-7d7f-4f8f-8bbc-a8ab18b379c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:07.785312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 33/64] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:07.787694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c83ad-ed4b-4498-bf7b-6e329a36349f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.788182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c83ad-ed4b-4498-bf7b-6e329a36349f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.788680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c83ad-ed4b-4498-bf7b-6e329a36349f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.791528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 34/65] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:07.795514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 32/66] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:07.804703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e10aac-d54d-498a-a346-4e2beb81fb7d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.806375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e10aac-d54d-498a-a346-4e2beb81fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.806910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e10aac-d54d-498a-a346-4e2beb81fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.812909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40e658-e78c-4478-a26b-dbf1b334e5d4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.813176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40e658-e78c-4478-a26b-dbf1b334e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.814127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40e658-e78c-4478-a26b-dbf1b334e5d4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.814916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 33/67] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:07.815804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40e658-e78c-4478-a26b-dbf1b334e5d4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:07.828134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a3e10aac-d54d-498a-a346-4e2beb81fb7d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:07.829327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a3e10aac-d54d-498a-a346-4e2beb81fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:07.832234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:07.847689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:07.904470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 35/68] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:07.905236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e10aac-d54d-498a-a346-4e2beb81fb7d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:07.927780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40e658-e78c-4478-a26b-dbf1b334e5d4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:07.968082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcca12-c216-44c3-bf18-dd5fd009bad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:07.968740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcca12-c216-44c3-bf18-dd5fd009bad4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.969024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcca12-c216-44c3-bf18-dd5fd009bad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.969304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcca12-c216-44c3-bf18-dd5fd009bad4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:07.981833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcca12-c216-44c3-bf18-dd5fd009bad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8cfcca12-c216-44c3-bf18-dd5fd009bad4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:07.986821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:07.987807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:07.988612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:07.989846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfae274-cf4b-4d43-901c-89d405f42f52 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:07.990021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfae274-cf4b-4d43-901c-89d405f42f52 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:07.990268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfae274-cf4b-4d43-901c-89d405f42f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.007691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9dfae274-cf4b-4d43-901c-89d405f42f52 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:08.009140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9dfae274-cf4b-4d43-901c-89d405f42f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:08.028792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e10aac-d54d-498a-a346-4e2beb81fb7d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.064715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.065366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.065654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.065932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.074202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.077603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:08.079562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:08.083038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:08.084054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:08.084869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:08.085525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.092248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfae274-cf4b-4d43-901c-89d405f42f52 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.119648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.194659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62813b32-8def-43ad-91e5-f1537d5a90f9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.205108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfae274-cf4b-4d43-901c-89d405f42f52 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.231012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.231659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.231938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.232214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.232928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:08.233234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.234624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.239776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.240404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.240687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.240963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.243077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 37/72] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.243813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.252416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:08.257761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:08.258665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:08.259480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:08.260132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.311883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.338708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.352619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cccd2-2a70-4869-87a6-2888ce89c343 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.360566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72cc7-a92d-49c1-85e1-692fd9ae2fa9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.386089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065335e-6ab8-4769-b978-fc783a928dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.386901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065335e-6ab8-4769-b978-fc783a928dad None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.387184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065335e-6ab8-4769-b978-fc783a928dad None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.387496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065335e-6ab8-4769-b978-fc783a928dad None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.388208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065335e-6ab8-4769-b978-fc783a928dad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:08.388515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065335e-6ab8-4769-b978-fc783a928dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.389889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065335e-6ab8-4769-b978-fc783a928dad None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.394371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.395004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.395308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.395589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.397705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.399609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136d3d4-eee7-40a8-a9cc-a83ba4988b55 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.399911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136d3d4-eee7-40a8-a9cc-a83ba4988b55 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.400192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136d3d4-eee7-40a8-a9cc-a83ba4988b55 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.401659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 39/75] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:08.402196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136d3d4-eee7-40a8-a9cc-a83ba4988b55 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.406688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:08.412071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:08.412961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:08.413719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 37/76] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:08.414904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.506529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136d3d4-eee7-40a8-a9cc-a83ba4988b55 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.514496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbce4cf-fafb-4ee4-9cdb-67b093d7a960 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.529004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.541277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.541911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.542191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.542469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.548127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114547f8-f367-487e-8ad3-284c9bf6f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.548741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114547f8-f367-487e-8ad3-284c9bf6f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.549027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114547f8-f367-487e-8ad3-284c9bf6f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.549307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114547f8-f367-487e-8ad3-284c9bf6f9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.550027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114547f8-f367-487e-8ad3-284c9bf6f9e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:08.550333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114547f8-f367-487e-8ad3-284c9bf6f9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.551768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114547f8-f367-487e-8ad3-284c9bf6f9e1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.555991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.557345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.557452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.559204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 40/77] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.560088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.561587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 38/78] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.562787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c0ced-f41c-45ad-ad21-b91ce032fcdd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.563415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c0ced-f41c-45ad-ad21-b91ce032fcdd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.563698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c0ced-f41c-45ad-ad21-b91ce032fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.581028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-104c0ced-f41c-45ad-ad21-b91ce032fcdd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:08.582242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-104c0ced-f41c-45ad-ad21-b91ce032fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:08.648021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:08.649423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c0ced-f41c-45ad-ad21-b91ce032fcdd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.662073 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be073eb8-a880-484d-8b1a-d111b5ab52a8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.696405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.697118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.697398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.697671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] PATH_INFO: `/v3/users/7081d973c3644a09a5c8eaa060094b63` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.698850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] RBAC: Authorizing `identity:get_user(user_id=7081d973c3644a09a5c8eaa060094b63)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.700344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.702077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/users/7081d973c3644a09a5c8eaa060094b63 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.702759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.752713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.757413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c0ced-f41c-45ad-ad21-b91ce032fcdd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.787842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.794399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.795017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.795326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.795605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.796315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:08.796620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.797999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.802333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb966b-fba3-4909-a4ae-a78650077e7b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.807079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.807911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.837673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.838317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.838601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.838884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.840081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.841539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.843313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.843990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:08.907357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be4618-2da9-447a-94e8-3eb26b125e25 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.940786 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.941394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.941673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.941948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.942168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f380c-5494-4a1c-aea4-8cc32e8bd276 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:08.959684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:08.977499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:08.978133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:08.978439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:08.978712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:08.979866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:08.981303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:08.982875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 43/83] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:08.983657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.002235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.012807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.014246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.084701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20412c6-3ca0-4ae2-ad55-e30fcc0aecaa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.113659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:09.114509 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.119668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.120288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:09.120570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:09.120848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:09.177252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.190705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.192216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.206699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.217076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c1ea-033b-4d45-bb39-1a5a98f8ac7b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.249352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.249988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:09.250266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:09.250543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:09.251980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.253562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.255164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:09 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:09.255952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.296239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 44/86] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:09.297059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.359476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ba50d-eb89-46d8-8202-e0192e228ae3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.378833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.393894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.394517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:09.394614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a778c-d199-4a89-a4ff-679eb5ec502e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.394803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:09.395081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:09.422499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.428886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.429510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:09.429796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:09.430572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:09.431256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.432731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.459152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 45/87] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:09 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:09.460005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.464849 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.466371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.588196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 43/88] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:09.588196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.588445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f081c98-9039-47c8-bbe5-969b4fc5fcf6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.627968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.627968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:09.627968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:09.628311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:09.629483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.630982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.632846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 46/89] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:09 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:09.635791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.647985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.656219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.713894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900336a-b908-41c0-8990-51381db1b983 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.765359 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.765892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138bc67-ca21-4d1a-b0cb-af96997f6f0c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.766322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:09.766322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:09.766529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:09.813548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.814577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:09.815201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:09.815739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:09.817955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.819794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.823047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 47/90] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:09 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:09.824148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.859658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:09.861679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:09.916280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.930159 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:09.950579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3fea-1c99-48ad-b3ec-5288a64dab86 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:09.981089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 44/91] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:09.981964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:09.998341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:09.999620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:10.000108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:10.000806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:10.002643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:10.004947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:10.007405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 48/92] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:09 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:10.009371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:10.119197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a6374-f0f3-4c8d-9b29-e9e9e3afe0ef None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:10.124608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72582a-2bcd-4032-aa7b-7b132a114ca9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:10.162133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:10.162939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:10.163351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:10.163747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:10.164735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=7081d973c3644a09a5c8eaa060094b63) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:10.165157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:10.166728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:10.167248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:10.168165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:10.168591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:10.169304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:10.170762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=1a4eb63f190c4bfc82747aa57602f4f6) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:10.171243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:10.173162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:10.173499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 49/93] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:10 2022] GET /identity/v3/role_assignments?user.id=7081d973c3644a09a5c8eaa060094b63&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:10.174445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:10.181761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 45/94] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:09 2022] GET /identity/v3/role_assignments?user.id=1a4eb63f190c4bfc82747aa57602f4f6&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:10.182857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:10.199549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:10.247654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:10.393794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995418c6-ee8c-4aca-9c80-e7f8c99240aa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:10.405047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30965ca-afc6-4994-877c-3e0eec0bc210 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:10.439561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:10.440466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:10.440587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:10.440865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] PATH_INFO: `/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:10.446717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] RBAC: Authorizing `identity:get_project(project_id=90dc212b99c54e0183c7fb47f22ca9a7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:10.446717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:10.446717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 50/95] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:10 2022] GET /identity/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7 => generated 312 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:10.452130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:10.472116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4a3d-b263-4b01-bd87-80f404c018bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:10.473228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4a3d-b263-4b01-bd87-80f404c018bb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:10.473714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4a3d-b263-4b01-bd87-80f404c018bb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:10.474209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4a3d-b263-4b01-bd87-80f404c018bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:10.475360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4a3d-b263-4b01-bd87-80f404c018bb None admin] RBAC: Adding query filter params (role.id=e74e413191434331b30c59872ddd2015, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=1a4eb63f190c4bfc82747aa57602f4f6) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:10.475881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4a3d-b263-4b01-bd87-80f404c018bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:10.484530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4a3d-b263-4b01-bd87-80f404c018bb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:10.490991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 46/96] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:10 2022] GET /identity/v3/role_assignments?user.id=1a4eb63f190c4bfc82747aa57602f4f6&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=e74e413191434331b30c59872ddd2015 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:10.568789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:10.594439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732a21-968e-430e-b7e0-39525980a56d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:10.637141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd2fd-bacc-4e55-a734-4ba85863193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:10.637767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd2fd-bacc-4e55-a734-4ba85863193e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:10.638049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd2fd-bacc-4e55-a734-4ba85863193e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:10.638328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd2fd-bacc-4e55-a734-4ba85863193e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:10.639130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd2fd-bacc-4e55-a734-4ba85863193e None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=90dc212b99c54e0183c7fb47f22ca9a7, user.id=1a4eb63f190c4bfc82747aa57602f4f6) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:10.639476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd2fd-bacc-4e55-a734-4ba85863193e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:10.640956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd2fd-bacc-4e55-a734-4ba85863193e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:10.647846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 51/97] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:10 2022] GET /identity/v3/role_assignments?user.id=1a4eb63f190c4bfc82747aa57602f4f6&scope.project.id=90dc212b99c54e0183c7fb47f22ca9a7&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:11.757959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcfe8d-c242-43a8-be94-2f32b796d025 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:11.759607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcfe8d-c242-43a8-be94-2f32b796d025 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:11.759899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcfe8d-c242-43a8-be94-2f32b796d025 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:11.761781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 47/98] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:11.773168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6a0b-18b6-44fa-ac43-b8307511834c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:11.773608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6a0b-18b6-44fa-ac43-b8307511834c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:11.773793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a6a0b-18b6-44fa-ac43-b8307511834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:11.804302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1d7a6a0b-18b6-44fa-ac43-b8307511834c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:11.806162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1d7a6a0b-18b6-44fa-ac43-b8307511834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:11.897392 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 52/99] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:11.932496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcfe8d-c242-43a8-be94-2f32b796d025 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:12.054360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:12.074066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcfe8d-c242-43a8-be94-2f32b796d025 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:12.119734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b2acc-491d-46d9-8445-14e842d39a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:12.120383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b2acc-491d-46d9-8445-14e842d39a31 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:12.120670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b2acc-491d-46d9-8445-14e842d39a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:12.120948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b2acc-491d-46d9-8445-14e842d39a31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:12.140144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b2acc-491d-46d9-8445-14e842d39a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-cc5b2acc-491d-46d9-8445-14e842d39a31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:12.145594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:12.146464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:12.147242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 48/100] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:12.153365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6a0b-18b6-44fa-ac43-b8307511834c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:12.255603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd84882-5601-4f97-931a-f6a67dd78ede None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:12.256272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd84882-5601-4f97-931a-f6a67dd78ede None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:12.256457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:12.257033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd84882-5601-4f97-931a-f6a67dd78ede None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:12.258896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 49/101] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:12.264784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486230-1c6f-4fb4-ac2f-19d03b3a8a06 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:12.265353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486230-1c6f-4fb4-ac2f-19d03b3a8a06 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:12.265842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4486230-1c6f-4fb4-ac2f-19d03b3a8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:12.301123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a6a0b-18b6-44fa-ac43-b8307511834c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:12.308395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c4486230-1c6f-4fb4-ac2f-19d03b3a8a06 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:12.309852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c4486230-1c6f-4fb4-ac2f-19d03b3a8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:12.341643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:12.342553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:12.343010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:12.343484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:12.344366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:12.344816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:12.346380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:12.356802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 53/102] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:12.365934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:12.473484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 50/103] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:12.508511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4486230-1c6f-4fb4-ac2f-19d03b3a8a06 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:12.567095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19815-7c6b-41c5-848a-5e0ffdfbd021 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:12.636310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:12.637426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:12.637906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:12.638374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] PATH_INFO: `/v3/users/7ebe57ee6db4483fba6c853978b16fd6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:12.651561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:12.664569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] RBAC: Authorizing `identity:get_user(user_id=7ebe57ee6db4483fba6c853978b16fd6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:12.666482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:12.670955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 54/104] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:12 2022] GET /identity/v3/users/7ebe57ee6db4483fba6c853978b16fd6 => generated 289 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:12.671242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:12.677214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:12.725776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4486230-1c6f-4fb4-ac2f-19d03b3a8a06 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:12.798447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:12.799204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:12.799427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:12.799712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:12.801129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:12.805287 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:12.807079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 51/105] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:12.812693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:12.837504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36337c83-3856-47d8-a405-cfccc327f720 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:12.909476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7e10-e57c-4477-8025-cc00c7e70afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:12.910118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7e10-e57c-4477-8025-cc00c7e70afb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:12.910457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7e10-e57c-4477-8025-cc00c7e70afb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:12.910743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7e10-e57c-4477-8025-cc00c7e70afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.034916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619516f-ef58-4bfd-b87f-dc54a6f41644 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:13.047667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:13.052395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7e10-e57c-4477-8025-cc00c7e70afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:13.053921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7e10-e57c-4477-8025-cc00c7e70afb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:13.096330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:13.096939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.097234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.097518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.098281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:13.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:13.152834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:13.164229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 52/106] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:04:12 2022] POST /identity/v3/projects => generated 302 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:04:13.300350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 55/107] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 04:04:13.307485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:13.423585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac8fd2-af00-405b-b6f0-dbe34b71188d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.424268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac8fd2-af00-405b-b6f0-dbe34b71188d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.424749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac8fd2-af00-405b-b6f0-dbe34b71188d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.426314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 56/108] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:13.434746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850554-4745-4897-b9dd-c1b6c7076c43 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.435882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850554-4745-4897-b9dd-c1b6c7076c43 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.436356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850554-4745-4897-b9dd-c1b6c7076c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.465518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2d850554-4745-4897-b9dd-c1b6c7076c43 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:13.467100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2d850554-4745-4897-b9dd-c1b6c7076c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:13.501569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2147be-81e5-4340-90f4-36f18905a813 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:13.577028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:13.577688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.577969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.578245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.580812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:13.582267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:13.591694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 53/109] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:13 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:13.592909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:13.630676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 57/110] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:13.654144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267cd28-fed7-494c-96ac-e870d40de826 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.654438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267cd28-fed7-494c-96ac-e870d40de826 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.654696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267cd28-fed7-494c-96ac-e870d40de826 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.656090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 58/111] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:13.659685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267cd28-fed7-494c-96ac-e870d40de826 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:13.690677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:13.698579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:13.741044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336699f-75ae-4ff9-8850-a2c40d9b126c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:13.782833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba28b-86eb-4ae9-8037-f06c2615cde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:13.783522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba28b-86eb-4ae9-8037-f06c2615cde4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.783805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba28b-86eb-4ae9-8037-f06c2615cde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.784076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba28b-86eb-4ae9-8037-f06c2615cde4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.784875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba28b-86eb-4ae9-8037-f06c2615cde4 None admin] RBAC: Adding query filter params (role.id=c35873f04035439aa38ba837a7579bb9, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=7ebe57ee6db4483fba6c853978b16fd6) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:13.785186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba28b-86eb-4ae9-8037-f06c2615cde4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:13.786623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba28b-86eb-4ae9-8037-f06c2615cde4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:13.793262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 54/112] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:13 2022] GET /identity/v3/role_assignments?user.id=7ebe57ee6db4483fba6c853978b16fd6&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=c35873f04035439aa38ba837a7579bb9 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:13.800728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8ded-bc04-4bff-86df-5a4be8710c3f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.802238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8ded-bc04-4bff-86df-5a4be8710c3f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.803300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8ded-bc04-4bff-86df-5a4be8710c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.804107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267cd28-fed7-494c-96ac-e870d40de826 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:13.837632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d69c8ded-bc04-4bff-86df-5a4be8710c3f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:13.839362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d69c8ded-bc04-4bff-86df-5a4be8710c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:13.857842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037325bb-5edd-4e02-b090-0ebada0c18df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:13.858612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037325bb-5edd-4e02-b090-0ebada0c18df None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.858965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037325bb-5edd-4e02-b090-0ebada0c18df None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.859402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037325bb-5edd-4e02-b090-0ebada0c18df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.872406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037325bb-5edd-4e02-b090-0ebada0c18df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-037325bb-5edd-4e02-b090-0ebada0c18df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:13.878069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:13.879035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:13.879863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 59/113] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:13.881654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0490-8aa1-4b6d-b040-9215f166c06a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.882052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0490-8aa1-4b6d-b040-9215f166c06a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.882436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0490-8aa1-4b6d-b040-9215f166c06a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.885050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 60/114] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:13.890518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17873430-98f2-46dc-9ab6-94ddca07ffae None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.890518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17873430-98f2-46dc-9ab6-94ddca07ffae None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.890518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17873430-98f2-46dc-9ab6-94ddca07ffae None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.890518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 61/115] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:13.890518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17873430-98f2-46dc-9ab6-94ddca07ffae None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:13.934358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 55/116] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:13.936115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f60a7d-0b29-4b91-b349-c8cdd2a9f340 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:13.936610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f60a7d-0b29-4b91-b349-c8cdd2a9f340 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:13.937124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f60a7d-0b29-4b91-b349-c8cdd2a9f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:13.958300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c0f60a7d-0b29-4b91-b349-c8cdd2a9f340 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:13.959910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0f60a7d-0b29-4b91-b349-c8cdd2a9f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:13.988281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.015325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17873430-98f2-46dc-9ab6-94ddca07ffae None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.030490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.045014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 56/117] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:14.047510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cde615-9120-4554-ac9d-cabba53fbb25 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.048721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cde615-9120-4554-ac9d-cabba53fbb25 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.049147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cde615-9120-4554-ac9d-cabba53fbb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.073341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-74cde615-9120-4554-ac9d-cabba53fbb25 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:14.074783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-74cde615-9120-4554-ac9d-cabba53fbb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:14.078585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.079199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.079645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.080029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.080926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:14.081516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:14.083125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:14.097896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 62/118] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:14.098831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.167241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 57/119] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:14.168504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cde615-9120-4554-ac9d-cabba53fbb25 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.219028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd6fd-458f-456b-b53f-da31893bd65d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.265669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.266515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.266901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.267315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.279744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:14.285520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:14.286498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:14.287482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:14.295315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 63/120] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:14.295315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.300374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.316046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cde615-9120-4554-ac9d-cabba53fbb25 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.339586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.361941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.362592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.362878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.363158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.374313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:14.379378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:14.380228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:14.381023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 58/121] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:14.381676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.466145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2c41-3c32-450b-926d-2f7d9ade0c2b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.514462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.515605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.515710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f19e-5ae7-43d3-81a4-c63f8b7c3889 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.516273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.516738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.518651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:14.520861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:14.528035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 64/122] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:14.528035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.568895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.569892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.570371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.572365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.587209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:14.594779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:14.595671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:14.596460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:14.598900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 59/123] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:14.600263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.613054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.654929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1b65-e930-4930-907b-2f0fc31e0871 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.663960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.692727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.693452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.693743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.694024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.694843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:14.695158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:14.697357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:14.710563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 65/124] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:14.710563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.755650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9970-a18b-4984-be6c-85b7c38343e7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.794506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.795461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.795972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.796393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.797263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:14.797748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:14.799494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:14.810014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 60/125] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:14.811864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.833916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee2815-bc62-4268-b2c1-4da6742177d8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.869692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.870739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.871069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.871392 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.872656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:14.874274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:14.880586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 66/126] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:14.880586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:14.884277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.929800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750502c4-316e-43b0-ad29-fc52c1f9a815 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:14.932561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:14.970588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:14.971480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:14.971906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:14.972365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:14.973258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:14.973768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:14.975699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:14.984390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 61/127] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:14.985503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.000390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c646e08-0543-4984-b458-0a9e95a79513 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.037673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.038218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.038509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.038787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] PATH_INFO: `/v3/users/7081d973c3644a09a5c8eaa060094b63` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.040494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] RBAC: Authorizing `identity:get_user(user_id=7081d973c3644a09a5c8eaa060094b63)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.041951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.043699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 67/128] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/users/7081d973c3644a09a5c8eaa060094b63 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:15.048390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.104507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67754346-72aa-4f1b-be82-8fc0913a3f0b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.119825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:15.143953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.145028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.145512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.146037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.147440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.149414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.151312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 62/129] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:14 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:15.151568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef8bd3-a951-4890-b257-3aeac6e105c6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.152731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.186862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.187663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.187876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.188108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/1a4eb63f190c4bfc82747aa57602f4f6/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.190054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb483f0975a64603b7294f5ce29aa037, user_id=1a4eb63f190c4bfc82747aa57602f4f6, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.191549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.191926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:15.215125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 68/130] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:15 2022] PUT /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/1a4eb63f190c4bfc82747aa57602f4f6/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:15.215125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.317174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0600f-16cb-471f-9ca4-57522cf02eab None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.370994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.371998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.372427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.372850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.374177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.375857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.377771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 63/131] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:15 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:15.387290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.407322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809be02-f671-41c9-ab4a-51fefd9bea40 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.435757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:15.443351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.444585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.444885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.445212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.446618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.449037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.455658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 69/132] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:15 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:15.456511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.513764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e595-d5f7-45de-8dd0-1868301918df None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.521053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:15.550742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.551424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.551712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.551994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.553338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.555408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.557200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 64/133] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:15 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:15.557953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.569790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f930ba-72a0-4353-a44c-911fa43689b3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.615875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.616582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.617955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.618244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] PATH_INFO: `/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.619754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] RBAC: Authorizing `identity:get_project(project_id=90dc212b99c54e0183c7fb47f22ca9a7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.621804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.624104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 70/134] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:15 2022] GET /identity/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:15.624939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.672791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945d895-f67c-4434-bb48-41958b404010 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.707627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.708309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.708594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.708876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/7081d973c3644a09a5c8eaa060094b63/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.709384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:15.711053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] RBAC: Authorizing `identity:create_grant(project_id=cb483f0975a64603b7294f5ce29aa037, user_id=7081d973c3644a09a5c8eaa060094b63, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.713058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.760196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1550f00-b666-49de-90e8-827091a91c67 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.762152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 65/135] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:15 2022] PUT /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/7081d973c3644a09a5c8eaa060094b63/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:15.762983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:15.802057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90c792-0bac-4b54-8bd9-1082d7fc2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.802772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c792-0bac-4b54-8bd9-1082d7fc2638 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.803061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c792-0bac-4b54-8bd9-1082d7fc2638 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.803411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c792-0bac-4b54-8bd9-1082d7fc2638 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/1a4eb63f190c4bfc82747aa57602f4f6/roles/e74e413191434331b30c59872ddd2015` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.807034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90c792-0bac-4b54-8bd9-1082d7fc2638 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb483f0975a64603b7294f5ce29aa037, user_id=1a4eb63f190c4bfc82747aa57602f4f6, role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.808910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90c792-0bac-4b54-8bd9-1082d7fc2638 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.826095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 71/136] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:15 2022] PUT /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/1a4eb63f190c4bfc82747aa57602f4f6/roles/e74e413191434331b30c59872ddd2015 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:15.848150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:15.936542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edbbb9-9f88-46db-8fd9-6ee4750eb19f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:15.976258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7f0f4-26fd-4ff2-8a69-b31eda24c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:15.977678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f0f4-26fd-4ff2-8a69-b31eda24c3cb None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.978034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f0f4-26fd-4ff2-8a69-b31eda24c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.978324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f0f4-26fd-4ff2-8a69-b31eda24c3cb None admin] PATH_INFO: `/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7/users/1a4eb63f190c4bfc82747aa57602f4f6/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:15.980609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7f0f4-26fd-4ff2-8a69-b31eda24c3cb None admin] RBAC: Authorizing `identity:create_grant(project_id=90dc212b99c54e0183c7fb47f22ca9a7, user_id=1a4eb63f190c4bfc82747aa57602f4f6, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:15.982163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7f0f4-26fd-4ff2-8a69-b31eda24c3cb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:15.997193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa01e-39e7-4078-b4f7-799e0061c20f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:15.997728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa01e-39e7-4078-b4f7-799e0061c20f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:15.997951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa01e-39e7-4078-b4f7-799e0061c20f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.001795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 66/137] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:15 2022] PUT /identity/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7/users/1a4eb63f190c4bfc82747aa57602f4f6/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:16.001983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 72/138] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:16.015212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a3fbb-a2f7-45d5-ab3c-2cff02599c37 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.015560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a3fbb-a2f7-45d5-ab3c-2cff02599c37 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.015819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a3fbb-a2f7-45d5-ab3c-2cff02599c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.041960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d66a3fbb-a2f7-45d5-ab3c-2cff02599c37 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:16.043244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d66a3fbb-a2f7-45d5-ab3c-2cff02599c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:16.059065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1251b-54d8-462e-8ec9-d075c6433532 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.059395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1251b-54d8-462e-8ec9-d075c6433532 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.059830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1251b-54d8-462e-8ec9-d075c6433532 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.063854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 73/139] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:16.076401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5c391-bd4c-41d8-98d7-2156447158d8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.076781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5c391-bd4c-41d8-98d7-2156447158d8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.077069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5c391-bd4c-41d8-98d7-2156447158d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.111868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a4e5c391-bd4c-41d8-98d7-2156447158d8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:16.113344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a4e5c391-bd4c-41d8-98d7-2156447158d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:16.124804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 67/140] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:16.153029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a3fbb-a2f7-45d5-ab3c-2cff02599c37 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:16.176897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:16.192566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 74/141] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:16.227334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5c391-bd4c-41d8-98d7-2156447158d8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:16.308062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:16.358441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5c391-bd4c-41d8-98d7-2156447158d8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:16.378741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a3fbb-a2f7-45d5-ab3c-2cff02599c37 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:16.398694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:16.399497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.399790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.400078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.411974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:16.417376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:16.418304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:16.419104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 75/142] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:16.424616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:16.457449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:16.458115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.458403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.458681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.464036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:16.465530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:16.467193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 68/143] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:16.472872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:16.538361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231840-3ba1-4fe4-9840-b1df7c776baf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:16.571665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:16.579964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:16.580817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.581115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.581381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.582121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:16.582440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:16.584586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:16.593865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 76/144] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:16.599779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:16.680923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:16.717070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a1334-e4cc-4c71-bf8f-aad272f55a2f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:16.759664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0437-8d5a-43ad-b4f1-89fa4a46b350 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:16.764690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:16.765690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.766173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.766660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] PATH_INFO: `/v3/users/7ebe57ee6db4483fba6c853978b16fd6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.769190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] RBAC: Authorizing `identity:get_user(user_id=7ebe57ee6db4483fba6c853978b16fd6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:16.770908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:16.772878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 77/145] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:16 2022] GET /identity/v3/users/7ebe57ee6db4483fba6c853978b16fd6 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:16.779467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:16.847656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:16.891275 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e3ff-0d41-491a-8450-e6aa04c39488 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:16.916002 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50207a2-3180-418f-bb6a-2be52a3b445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:16.916654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50207a2-3180-418f-bb6a-2be52a3b445c None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.916948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50207a2-3180-418f-bb6a-2be52a3b445c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.917234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50207a2-3180-418f-bb6a-2be52a3b445c None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.917945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50207a2-3180-418f-bb6a-2be52a3b445c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:16.919435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50207a2-3180-418f-bb6a-2be52a3b445c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:16.926870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:16.927574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:16.927861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:16.928136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:16.929304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:16.931494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:16.933119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 78/146] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:16 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:16.939241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:16.976041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 69/147] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:16 2022] POST /identity/v3/users => generated 283 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:04:17.050572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383f46-ae28-43a8-941a-11a2fb713884 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:17.080030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:17.089855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2398d-64c2-4d9f-96eb-feaa2b36a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:17.090550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2398d-64c2-4d9f-96eb-feaa2b36a2ba None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:17.090835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2398d-64c2-4d9f-96eb-feaa2b36a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:17.091129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2398d-64c2-4d9f-96eb-feaa2b36a2ba None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/7ebe57ee6db4483fba6c853978b16fd6/roles/c35873f04035439aa38ba837a7579bb9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:17.093252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2398d-64c2-4d9f-96eb-feaa2b36a2ba None admin] RBAC: Authorizing `identity:create_grant(project_id=cb483f0975a64603b7294f5ce29aa037, user_id=7ebe57ee6db4483fba6c853978b16fd6, role_id=c35873f04035439aa38ba837a7579bb9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:17.094763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2398d-64c2-4d9f-96eb-feaa2b36a2ba None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:17.110648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 79/148] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:16 2022] PUT /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037/users/7ebe57ee6db4483fba6c853978b16fd6/roles/c35873f04035439aa38ba837a7579bb9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:04:18.519795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1e63-3334-45e4-9b36-b9c9a798f99e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.520341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1e63-3334-45e4-9b36-b9c9a798f99e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.520341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1e63-3334-45e4-9b36-b9c9a798f99e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.521728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 70/149] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:18.530411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f6f8-5020-4c46-a155-2fedc34b9670 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.530878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f6f8-5020-4c46-a155-2fedc34b9670 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.530967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f6f8-5020-4c46-a155-2fedc34b9670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.550162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6e53f6f8-5020-4c46-a155-2fedc34b9670 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:18.555455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6e53f6f8-5020-4c46-a155-2fedc34b9670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:18.626180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323afe2c-200b-49dd-89c9-cbc9f850b759 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.626494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323afe2c-200b-49dd-89c9-cbc9f850b759 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.626753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323afe2c-200b-49dd-89c9-cbc9f850b759 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.628145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 71/150] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:18.637474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 80/151] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:18.637638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae94d-cc94-4066-ad2b-26febbf509c0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.637896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae94d-cc94-4066-ad2b-26febbf509c0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.638182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae94d-cc94-4066-ad2b-26febbf509c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.667789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53f6f8-5020-4c46-a155-2fedc34b9670 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:18.674602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-255ae94d-cc94-4066-ad2b-26febbf509c0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:18.675877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-255ae94d-cc94-4066-ad2b-26febbf509c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:18.782923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53f6f8-5020-4c46-a155-2fedc34b9670 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:18.785742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:18.819692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:18.821054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.821370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.821565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.832437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 72/152] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:18.833624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:18.833734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89803da-67e0-4c17-8b8f-2c773aa80b33 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.834001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89803da-67e0-4c17-8b8f-2c773aa80b33 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.834283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89803da-67e0-4c17-8b8f-2c773aa80b33 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.835728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 73/153] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:18.839527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:18.840385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:18.841154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:18.841746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 81/154] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:18.842579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb5d7-89cc-4ede-99d3-284b33635d9f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.845632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb5d7-89cc-4ede-99d3-284b33635d9f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.845632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb5d7-89cc-4ede-99d3-284b33635d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.848249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:18.880274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a68eb5d7-89cc-4ede-99d3-284b33635d9f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:18.881473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a68eb5d7-89cc-4ede-99d3-284b33635d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:18.958828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8684646-c06c-4054-9300-7e67696a6185 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:18.996866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:18.997879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:18.998307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:18.998742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:18.999839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:19.000315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:19.001868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:19.012836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 82/155] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:19.013966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:19.063092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:19.064829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 74/156] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:19.065947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1800a-9304-4fb2-84fa-722cda624e04 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.066244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1800a-9304-4fb2-84fa-722cda624e04 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.066528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1800a-9304-4fb2-84fa-722cda624e04 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:19.067840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 75/157] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:19.068639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1800a-9304-4fb2-84fa-722cda624e04 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:19.071901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:19.127106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8abf2-ca03-4634-b0a7-c39fe561cd71 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:19.164883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15fa74-cc56-4745-91d5-2ca86326d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:19.165876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fa74-cc56-4745-91d5-2ca86326d973 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.166336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fa74-cc56-4745-91d5-2ca86326d973 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.166819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fa74-cc56-4745-91d5-2ca86326d973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:19.179230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15fa74-cc56-4745-91d5-2ca86326d973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2e15fa74-cc56-4745-91d5-2ca86326d973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:19.186485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:19.187636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:19.188515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:19.190963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 83/158] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:19.192679 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56fb5-a11a-484f-8d4a-e6c11edb6019 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.193155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56fb5-a11a-484f-8d4a-e6c11edb6019 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.193608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56fb5-a11a-484f-8d4a-e6c11edb6019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:19.225572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e3d56fb5-a11a-484f-8d4a-e6c11edb6019 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:19.228222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e3d56fb5-a11a-484f-8d4a-e6c11edb6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:19.325534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1800a-9304-4fb2-84fa-722cda624e04 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:19.339425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 84/159] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:19.340831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56fb5-a11a-484f-8d4a-e6c11edb6019 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:19.362745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:19.378660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:19.380069 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.380321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.380597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] PATH_INFO: `/v3/users/7081d973c3644a09a5c8eaa060094b63` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:19.381929 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=7081d973c3644a09a5c8eaa060094b63)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:19.384155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:19.386235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 76/160] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:19 2022] GET /identity/v3/users/7081d973c3644a09a5c8eaa060094b63 => generated 247 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:19.386796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:19.478338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:19.514961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d8674-d54d-40fc-b582-dd56f654b3f7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:19.558169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56fb5-a11a-484f-8d4a-e6c11edb6019 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:19.579974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:19.580577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.580804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.581080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:19.581810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:19.582113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:19.585545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:19.603363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 77/161] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:19.603970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:19.630618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:19.631287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.631570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.631845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:19.653444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:19.658434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:19.659380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 85/162] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:19.660579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:19.741907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec76a1f-8986-4a99-8a5e-c180922dbd31 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:19.778835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:19.779517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.779811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.780091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:19.782593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:19.810604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:19.816060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:19.816961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 78/163] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:19.818032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:19.825544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:19.880371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dcef2-5a47-400e-8cc0-809ee41f9ca1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:19.954853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:19.960747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:19.961961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:19.962444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:20.052111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d15d5-a936-4f42-bd0c-75a202842f63 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:20.088141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:20.090213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:20.094465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:20.094465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:20.094465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:20.094465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:20.095538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:20.096975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:20.098743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 79/164] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:19 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:20.099356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:20.173877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:20.235065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:20.275877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b687-10f1-4d5c-8cec-7263d518c812 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:20.287937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 86/165] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:20.288595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:20.361276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:20.361902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:20.362186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:20.362462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:20.363183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:20.363510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:20.364879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:20.382431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 80/166] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:20.383899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:20.505857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459156-f351-4dd3-87e9-2a64b6183105 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:20.589060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:20.590679 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:20.591171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:20.591692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:20.592631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:20.599284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:20.602333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:20.619885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 87/167] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:20.621022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:20.641485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9f4f5-abd3-464d-bc1f-992a2e5619fa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:20.666771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:20.679188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7247-75ff-4748-85f9-73166d0c222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:20.680890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7247-75ff-4748-85f9-73166d0c222e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:20.681444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7247-75ff-4748-85f9-73166d0c222e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:20.681951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7247-75ff-4748-85f9-73166d0c222e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:20.686268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:20.751976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2917-4de0-4927-91f9-c3aacfee9ee4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:20.768918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc7247-75ff-4748-85f9-73166d0c222e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:20.770708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc7247-75ff-4748-85f9-73166d0c222e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:20.811336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:20.811994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:20.812275 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:20.812549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:20.815634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:20.817112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:20.826244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 88/168] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:20 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:20.826244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:20.884583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 81/169] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:20.886599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac070-4dee-42ef-8960-0711c65c7ff4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:20.887090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac070-4dee-42ef-8960-0711c65c7ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:20.887593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac070-4dee-42ef-8960-0711c65c7ff4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:20.889079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 82/170] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:20.889974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac070-4dee-42ef-8960-0711c65c7ff4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:20.928443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:20.998651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac070-4dee-42ef-8960-0711c65c7ff4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.036282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.037293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.037778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.038271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.039167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0228-8295-42cd-af71-6c133cb76423 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.039983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:21.041855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:21.043777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 83/171] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:20 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:21.048643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.050502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:21.149521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.158276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.158972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.159254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.159559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] PATH_INFO: `/v3/users/1a4eb63f190c4bfc82747aa57602f4f6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.159980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80378cd2-b66a-405d-8e30-1e0a1ecf730e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.161412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4eb63f190c4bfc82747aa57602f4f6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:21.163513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:21.169682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 89/172] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:20 2022] GET /identity/v3/users/1a4eb63f190c4bfc82747aa57602f4f6 => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:21.170116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:21.199389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676561-37ec-4db6-b9bd-5daa61cead9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.200409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676561-37ec-4db6-b9bd-5daa61cead9e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.200892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676561-37ec-4db6-b9bd-5daa61cead9e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.201419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676561-37ec-4db6-b9bd-5daa61cead9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.202440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676561-37ec-4db6-b9bd-5daa61cead9e None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=7081d973c3644a09a5c8eaa060094b63) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:21.203003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676561-37ec-4db6-b9bd-5daa61cead9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:21.204859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676561-37ec-4db6-b9bd-5daa61cead9e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:21.211488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 84/173] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:21 2022] GET /identity/v3/role_assignments?user.id=7081d973c3644a09a5c8eaa060094b63&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:21.216688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf719f4b-8e8d-442c-841d-873cd887d78a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.217303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf719f4b-8e8d-442c-841d-873cd887d78a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.217794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf719f4b-8e8d-442c-841d-873cd887d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.255156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cf719f4b-8e8d-442c-841d-873cd887d78a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:21.258383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cf719f4b-8e8d-442c-841d-873cd887d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:21.364899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 85/174] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:21.366117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf719f4b-8e8d-442c-841d-873cd887d78a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:21.388160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261a99-654f-4e04-bc2e-04f6981c9357 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.435709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.436417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.436997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.437281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.438525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:21.440040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:21.442107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 90/175] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:21 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:21.447197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:21.468751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.495366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf719f4b-8e8d-442c-841d-873cd887d78a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.509854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.535575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a8242-751e-454d-9cad-af4d6a1807d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.536234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8242-751e-454d-9cad-af4d6a1807d4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.536520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8242-751e-454d-9cad-af4d6a1807d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.536796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8242-751e-454d-9cad-af4d6a1807d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.579654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85bbf7-3473-4bc3-9962-e17afdc30dab None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.610385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a8242-751e-454d-9cad-af4d6a1807d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:21.611919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a8242-751e-454d-9cad-af4d6a1807d4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:21.614776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.615553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.615780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.616053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.687780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:21.689457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:21.700581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.717103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 86/176] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:21.718144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5480-d2a4-4c39-bcb5-d15484a6230e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.718428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5480-d2a4-4c39-bcb5-d15484a6230e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.718708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5480-d2a4-4c39-bcb5-d15484a6230e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.719992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 87/177] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:21.721013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1d44-2a32-4df5-a5c1-2675e44c44ea None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.721292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1d44-2a32-4df5-a5c1-2675e44c44ea None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.721729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1d44-2a32-4df5-a5c1-2675e44c44ea None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.722937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 88/178] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:21.723879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1d44-2a32-4df5-a5c1-2675e44c44ea None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:21.736431 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.797741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 91/179] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:21.798583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:21.832930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1d44-2a32-4df5-a5c1-2675e44c44ea None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.866655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b9fe5-4e36-4005-af10-a13abb051377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.867221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b9fe5-4e36-4005-af10-a13abb051377 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.867570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b9fe5-4e36-4005-af10-a13abb051377 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.868011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b9fe5-4e36-4005-af10-a13abb051377 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.878305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b9fe5-4e36-4005-af10-a13abb051377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e46b9fe5-4e36-4005-af10-a13abb051377 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:21.883908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:21.884825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:21.885901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 89/180] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:21.886568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a2f9f-81ba-4b44-8f27-fbbc50feb10e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.887113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a2f9f-81ba-4b44-8f27-fbbc50feb10e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.887113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a2f9f-81ba-4b44-8f27-fbbc50feb10e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.888295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 90/181] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:21.888997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a2f9f-81ba-4b44-8f27-fbbc50feb10e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:21.903450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fac5b-6a86-45ee-b7c0-40393de4e82f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:21.935610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.937169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2f1f-0918-4a11-b4e3-9ea5d08045cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:21.937862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2f1f-0918-4a11-b4e3-9ea5d08045cc None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.938216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2f1f-0918-4a11-b4e3-9ea5d08045cc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.938495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2f1f-0918-4a11-b4e3-9ea5d08045cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.939308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2f1f-0918-4a11-b4e3-9ea5d08045cc None admin] RBAC: Adding query filter params (role.id=e74e413191434331b30c59872ddd2015, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=1a4eb63f190c4bfc82747aa57602f4f6) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:21.939633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2f1f-0918-4a11-b4e3-9ea5d08045cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:21.941096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2f1f-0918-4a11-b4e3-9ea5d08045cc None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:21.947383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 92/182] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:21 2022] GET /identity/v3/role_assignments?user.id=1a4eb63f190c4bfc82747aa57602f4f6&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=e74e413191434331b30c59872ddd2015 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:21.948523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5b8e-85fd-4630-aa69-95418950ccfb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:21.948817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5b8e-85fd-4630-aa69-95418950ccfb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:21.949097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5b8e-85fd-4630-aa69-95418950ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:21.962475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:21.968497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3ded5b8e-85fd-4630-aa69-95418950ccfb None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:21.970503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3ded5b8e-85fd-4630-aa69-95418950ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:22.003096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a2f9f-81ba-4b44-8f27-fbbc50feb10e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.043285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57560826-7b8e-47c2-a08b-5f51d75b4504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.043952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560826-7b8e-47c2-a08b-5f51d75b4504 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.044238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560826-7b8e-47c2-a08b-5f51d75b4504 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.044518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560826-7b8e-47c2-a08b-5f51d75b4504 None admin] PATH_INFO: `/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.045724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57560826-7b8e-47c2-a08b-5f51d75b4504 None admin] RBAC: Authorizing `identity:get_project(project_id=90dc212b99c54e0183c7fb47f22ca9a7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.047200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57560826-7b8e-47c2-a08b-5f51d75b4504 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.054074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 91/183] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:21 2022] GET /identity/v3/projects/90dc212b99c54e0183c7fb47f22ca9a7 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.054276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 93/184] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:22.054276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded5b8e-85fd-4630-aa69-95418950ccfb None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.056701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6e56-f855-4cf8-ae75-0df08da328ad None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.056998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6e56-f855-4cf8-ae75-0df08da328ad None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.057332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6e56-f855-4cf8-ae75-0df08da328ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.084920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-629a6e56-f855-4cf8-ae75-0df08da328ad None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:22.086197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-629a6e56-f855-4cf8-ae75-0df08da328ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:22.164355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded5b8e-85fd-4630-aa69-95418950ccfb None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.177179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 92/185] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:22.178008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6e56-f855-4cf8-ae75-0df08da328ad None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.208574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e9d54-8ddb-4015-860a-3baa8f7a38e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.209227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e9d54-8ddb-4015-860a-3baa8f7a38e8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.209515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e9d54-8ddb-4015-860a-3baa8f7a38e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.209788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e9d54-8ddb-4015-860a-3baa8f7a38e8 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.210949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e9d54-8ddb-4015-860a-3baa8f7a38e8 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.212971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e9d54-8ddb-4015-860a-3baa8f7a38e8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.214639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 94/186] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.215783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d39e3-4d9f-4e28-9b82-9f1672b01d9f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.216067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d39e3-4d9f-4e28-9b82-9f1672b01d9f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.216343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d39e3-4d9f-4e28-9b82-9f1672b01d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.223142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.232200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.235376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6a9d39e3-4d9f-4e28-9b82-9f1672b01d9f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:22.236567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6a9d39e3-4d9f-4e28-9b82-9f1672b01d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:22.288972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6e56-f855-4cf8-ae75-0df08da328ad None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.301816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 95/187] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:22.302638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d39e3-4d9f-4e28-9b82-9f1672b01d9f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.329790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.330416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.330698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.330979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.331729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:22.332038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.333412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.342124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 93/188] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.342929 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.400516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d39e3-4d9f-4e28-9b82-9f1672b01d9f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.434563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.435106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.435421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.435694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.436477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=90dc212b99c54e0183c7fb47f22ca9a7, user.id=1a4eb63f190c4bfc82747aa57602f4f6) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:22.436784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.438223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.440010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.445195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 96/189] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/role_assignments?user.id=1a4eb63f190c4bfc82747aa57602f4f6&scope.project.id=90dc212b99c54e0183c7fb47f22ca9a7&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.446730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.451929 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f2ea-7574-4296-9f68-c2445e62e672 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.455644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.500044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.500835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.501169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.501457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.515001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:22.521962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:22.522917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 94/190] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:22.530053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.569178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907485bb-d9a7-485f-81f0-b779067afdb0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.611188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.611866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.612144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.612461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.625502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:22.632204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:22.633669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 97/191] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:22.636264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.646988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738ce0-5141-4a9d-957d-5619e05cb2e1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.684408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.685076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.685312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.685587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.686377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=1a4eb63f190c4bfc82747aa57602f4f6) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:22.686685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.688182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.693865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 95/192] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/role_assignments?user.id=1a4eb63f190c4bfc82747aa57602f4f6&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.694638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.700901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.730994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.759581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7a3a-7b0c-401a-84a9-8366d627981b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.798121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.798873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.799161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.799501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.801542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.803051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.804789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 98/193] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.807842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.821372 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7215599-238a-4f03-8b60-1b11eb873e26 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.864750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.864950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.865455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.865740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] PATH_INFO: `/v3/users/7ebe57ee6db4483fba6c853978b16fd6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.866920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] RBAC: Authorizing `identity:get_user(user_id=7ebe57ee6db4483fba6c853978b16fd6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.868919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.870866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 96/194] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/users/7ebe57ee6db4483fba6c853978b16fd6 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.871368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.927828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6d76-ca85-455a-867f-81c03a495a7f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:22.954213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.963498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:22.964121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:22.964403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:22.964707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:22.965451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:22.965757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:22.967146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:22.975204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 99/195] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:22.976039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:22.980775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:22.987154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe6f03-1c05-477b-8596-f8deea3e8acf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.021481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.022187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.022482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.022760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.023542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:23.023954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.025349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.036715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 97/196] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:23.036715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:23.075033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3556c8-9fd8-4986-9505-6c7f507d8a9a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.108210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.108821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.109100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.109374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.110052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.111531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.132559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 100/197] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:22 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:23.134394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:23.135123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684e54-e490-41d4-a47e-dce15d0ca99d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.176331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.176809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.177094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.177375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.193866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:23.210434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:23.261219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.262724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.263677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662e69-858f-4a1b-9043-ebea9c86a612 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.310929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.311984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.312279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.312554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] PATH_INFO: `/v3/users/eb7d67c998004d0f9af9980493330f9e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.327648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=eb7d67c998004d0f9af9980493330f9e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.329132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.330820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 101/198] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/users/eb7d67c998004d0f9af9980493330f9e => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:23.331716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:23.378153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 98/199] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:23.378908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:23.458260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:23.463935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae539d-f3b2-40d5-9589-b4cd573fc3d7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.465752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:23.513212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.514124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.514401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.514668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] PATH_INFO: `/v3/users/eb7d67c998004d0f9af9980493330f9e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.516677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] RBAC: Authorizing `identity:get_user(user_id=eb7d67c998004d0f9af9980493330f9e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.518301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.518708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3531-be12-4e5b-b8f8-a0c6a73174eb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.519957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 102/200] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/users/eb7d67c998004d0f9af9980493330f9e => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:23.520999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:23.564439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.565319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.565597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.565868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.637823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b976e9-106e-4b24-8d74-766d8774ad76 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.654775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.656744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.677786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.678424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.678698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.678964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.681436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.682907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.689317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 103/201] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:23.689317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:23.738029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:23.739721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:23.796729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 99/202] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:23.798050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:23.814726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9ca2-6592-4fba-9304-f6af0c60c1a1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.858971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.859641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.859923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.860201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.925855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893980c-452c-4d71-a71c-413e67fc8740 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:23.931498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.933195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.964820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:23.965461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:23.965790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:23.966072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:23.966872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] RBAC: Adding query filter params (role.id=c35873f04035439aa38ba837a7579bb9, scope.project.id=cb483f0975a64603b7294f5ce29aa037, user.id=7ebe57ee6db4483fba6c853978b16fd6) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:23.967187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:23.968938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:23.974975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:23.976746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 100/203] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/role_assignments?user.id=7ebe57ee6db4483fba6c853978b16fd6&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=c35873f04035439aa38ba837a7579bb9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:23.978012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:24.018616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:24.112311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bb80b-be82-4e2b-a99b-10b13679e97b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:24.153662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:24.154694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:24.155246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:24.155753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:24.157324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:24.159286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:24.161300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 101/204] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:24.171517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:24.182758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 104/205] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:24.191076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:24.288767 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:24.305130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397232b9-e09a-475c-85fe-254c166a18aa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:24.333227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f613f1-e3e9-47e8-ba06-6e3cd5a3193c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:24.345369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:24.346268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:24.346552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:24.346829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:24.347671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=eb7d67c998004d0f9af9980493330f9e) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:24.347982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:24.349439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:24.355484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 102/206] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:24 2022] GET /identity/v3/role_assignments?user.id=eb7d67c998004d0f9af9980493330f9e&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:24.376335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b5147-642a-45bb-8dc3-d762610d5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:24.377520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b5147-642a-45bb-8dc3-d762610d5245 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:24.377996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b5147-642a-45bb-8dc3-d762610d5245 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:24.378461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b5147-642a-45bb-8dc3-d762610d5245 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:24.379978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b5147-642a-45bb-8dc3-d762610d5245 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:24.381729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b5147-642a-45bb-8dc3-d762610d5245 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:24.384850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 105/207] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:24 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:24.391452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:24.513579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137c4f-da2f-487e-981c-994c18fcbaa5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:24.551436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011738f-5a6b-4575-953d-975db98d9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:24.552428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011738f-5a6b-4575-953d-975db98d9b70 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:24.552902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011738f-5a6b-4575-953d-975db98d9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:24.553369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011738f-5a6b-4575-953d-975db98d9b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:24.554435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011738f-5a6b-4575-953d-975db98d9b70 None admin] RBAC: Adding query filter params (role.id=e74e413191434331b30c59872ddd2015, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=eb7d67c998004d0f9af9980493330f9e) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:24.555501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011738f-5a6b-4575-953d-975db98d9b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:24.557325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011738f-5a6b-4575-953d-975db98d9b70 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:24.563253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 103/208] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:24 2022] GET /identity/v3/role_assignments?user.id=eb7d67c998004d0f9af9980493330f9e&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=e74e413191434331b30c59872ddd2015 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:25.357608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8db9-255c-44d6-a8f6-c9a8724b77fb None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.358125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8db9-255c-44d6-a8f6-c9a8724b77fb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.358125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8db9-255c-44d6-a8f6-c9a8724b77fb None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.359705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 106/209] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:25.364652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158615-5688-4b32-bd8a-c9f6fb181742 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.365061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158615-5688-4b32-bd8a-c9f6fb181742 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.365253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158615-5688-4b32-bd8a-c9f6fb181742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.384114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-10158615-5688-4b32-bd8a-c9f6fb181742 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:25.385290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-10158615-5688-4b32-bd8a-c9f6fb181742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:25.400395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:25.443172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c643-b27e-4d7f-a8f0-ef4bbf5686f1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.445044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c643-b27e-4d7f-a8f0-ef4bbf5686f1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.445044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c643-b27e-4d7f-a8f0-ef4bbf5686f1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.445243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 107/210] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:25.452352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a40a94-b656-46a0-8f2a-c5ffb1857d03 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.452637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a40a94-b656-46a0-8f2a-c5ffb1857d03 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.452912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a40a94-b656-46a0-8f2a-c5ffb1857d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.468909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:25.471596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 104/211] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:25.474711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a7a40a94-b656-46a0-8f2a-c5ffb1857d03 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:25.475948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a7a40a94-b656-46a0-8f2a-c5ffb1857d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:25.490124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10158615-5688-4b32-bd8a-c9f6fb181742 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:25.568131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:25.595099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a40a94-b656-46a0-8f2a-c5ffb1857d03 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:25.607502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10158615-5688-4b32-bd8a-c9f6fb181742 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:25.644544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:25.645502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.645992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.646466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.658649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:25.664743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:25.665687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:25.666501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:25.668957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:25.675378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:25.687865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:25.708641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a40a94-b656-46a0-8f2a-c5ffb1857d03 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:25.748580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:25.749534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.750110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.750580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.751987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:25.753875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:25.755999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:25.765328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:25.770075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:25.792719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5a17b-9c76-4a26-b6c5-5099005807b9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:25.831820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:25.832746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.833231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.833699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.834587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:25.835070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:25.837462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:25.846764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:25.852719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:25.878283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9886f-9ecf-432e-95e5-294e3fe612c4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:25.915222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:25.915554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:25.915796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:25.916075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:25.916769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:25.918232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:25.935932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:25.947470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 110/216] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:25 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:25.982009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beabc8-1501-42e4-8f6d-16bb375a18f3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:26.023164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:26.023909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.024193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.024475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] PATH_INFO: `/v3/users/5d11e45f7df14179ab6d48604ca8f3d5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.042729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] RBAC: Authorizing `identity:get_user(user_id=5d11e45f7df14179ab6d48604ca8f3d5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:26.044314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:26.046456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 107/217] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:25 2022] GET /identity/v3/users/5d11e45f7df14179ab6d48604ca8f3d5 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:26.051615 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:26.119513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:26.166000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c14aa1-3aa5-491e-9895-49a929c0bb9e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:26.202085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95851b-482c-4ec4-b567-9337d613a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:26.202715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95851b-482c-4ec4-b567-9337d613a87c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.202996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95851b-482c-4ec4-b567-9337d613a87c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.203351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95851b-482c-4ec4-b567-9337d613a87c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.280011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95851b-482c-4ec4-b567-9337d613a87c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:26.281518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95851b-482c-4ec4-b567-9337d613a87c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:26.351325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:26.398349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 111/218] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 04:04:26.404749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:26.433614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b3c9-f442-4cbb-bfea-cecca83c3f02 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.433797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b3c9-f442-4cbb-bfea-cecca83c3f02 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.434016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b3c9-f442-4cbb-bfea-cecca83c3f02 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.435782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 112/219] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:26.441701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858344-cc33-4cf9-90ee-1127f335803d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.442196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858344-cc33-4cf9-90ee-1127f335803d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.442639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858344-cc33-4cf9-90ee-1127f335803d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.466611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-54858344-cc33-4cf9-90ee-1127f335803d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:26.468119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-54858344-cc33-4cf9-90ee-1127f335803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:26.556760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 113/220] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:26.577477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f94e0-d34a-441c-8430-d41edaca3435 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:26.582880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858344-cc33-4cf9-90ee-1127f335803d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:26.639023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:26.661640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:26.662588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.663039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.663510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.666891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:26.668557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:26.670425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 108/221] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:26 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:26.676264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:26.738608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:26.755702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858344-cc33-4cf9-90ee-1127f335803d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:26.794439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be9885-c122-4585-89bf-8655f4a688f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:26.795473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be9885-c122-4585-89bf-8655f4a688f9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.795951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be9885-c122-4585-89bf-8655f4a688f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.796496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be9885-c122-4585-89bf-8655f4a688f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.811702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be9885-c122-4585-89bf-8655f4a688f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-64be9885-c122-4585-89bf-8655f4a688f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:26.817254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:26.818135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:26.818959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:26.822317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 114/222] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:26.827846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26c000-0ad7-43de-8b6d-5f2504bf6416 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:26.830128 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d8da-2e7d-41a5-adac-1799aee83cf2 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.830614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d8da-2e7d-41a5-adac-1799aee83cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.831080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d8da-2e7d-41a5-adac-1799aee83cf2 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.832915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 115/223] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:26.833834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5d8da-2e7d-41a5-adac-1799aee83cf2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:26.876223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835f148-ff39-4742-bc8d-e85c570edaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:26.877271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f148-ff39-4742-bc8d-e85c570edaeb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.877840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f148-ff39-4742-bc8d-e85c570edaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.878324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f148-ff39-4742-bc8d-e85c570edaeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.879384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835f148-ff39-4742-bc8d-e85c570edaeb None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=5d11e45f7df14179ab6d48604ca8f3d5) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:26.879958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835f148-ff39-4742-bc8d-e85c570edaeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:26.881711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835f148-ff39-4742-bc8d-e85c570edaeb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:26.889265 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 109/224] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:26 2022] GET /identity/v3/role_assignments?user.id=5d11e45f7df14179ab6d48604ca8f3d5&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:26.890799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3127-5020-4f2c-92c1-76555ed735b7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:26.891584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3127-5020-4f2c-92c1-76555ed735b7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:26.892221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3127-5020-4f2c-92c1-76555ed735b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:26.915470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-438c3127-5020-4f2c-92c1-76555ed735b7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:26.917102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-438c3127-5020-4f2c-92c1-76555ed735b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:26.964683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5d8da-2e7d-41a5-adac-1799aee83cf2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:27.003919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:27.004886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:27.005386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:27.005852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:27.006769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:27.007305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:27.010569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:27.012099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:27.020444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 116/225] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:27.027098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:27.034580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 110/226] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:27.045401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:27.069878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3127-5020-4f2c-92c1-76555ed735b7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:27.142610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0fc89-9bc1-4ba2-89be-abc873050586 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:27.183642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:27.184659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:27.185166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:27.185959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] PATH_INFO: `/v3/users/eb7d67c998004d0f9af9980493330f9e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:27.187533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] RBAC: Authorizing `identity:get_user(user_id=eb7d67c998004d0f9af9980493330f9e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:27.189470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:27.192376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 117/227] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:27 2022] GET /identity/v3/users/eb7d67c998004d0f9af9980493330f9e => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:27.197965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:27.245904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3127-5020-4f2c-92c1-76555ed735b7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:27.281997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:27.301273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed849-731c-4ba9-9aa0-35bb1d0a073c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:27.327984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149674-d824-4836-ac33-f905325aff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:27.328655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149674-d824-4836-ac33-f905325aff05 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:27.328942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149674-d824-4836-ac33-f905325aff05 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:27.329221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149674-d824-4836-ac33-f905325aff05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:27.337344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:27.338232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:27.338723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:27.339190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:27.340627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:27.342336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:27.344252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 118/228] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:27 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:27.352494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:27.359894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149674-d824-4836-ac33-f905325aff05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-97149674-d824-4836-ac33-f905325aff05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:27.366389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:27.367420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:27.368433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 111/229] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:27.373470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149674-d824-4836-ac33-f905325aff05 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:27.468214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e9dc1-24df-4aae-bd69-45c4818157ed None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:27.504141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:27.505203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:27.505678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:27.506161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/eb7d67c998004d0f9af9980493330f9e/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:27.509216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee2fa4db020d49458f66a1e5b82688be, user_id=eb7d67c998004d0f9af9980493330f9e, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:27.511189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:27.511616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:27.529014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 119/230] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:27 2022] PUT /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/eb7d67c998004d0f9af9980493330f9e/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:27.592611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149674-d824-4836-ac33-f905325aff05 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:27.642191 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:27.642842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:27.643124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:27.643432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:27.644180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:27.644485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:27.645896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:27.660011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 112/231] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:27.666384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:27.679691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:27.801855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee3c3-3ad0-4057-a310-fa262c093a39 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:27.854835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:27.855422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:27.855701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:27.855974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] PATH_INFO: `/v3/users/eb7d67c998004d0f9af9980493330f9e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:27.857154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] RBAC: Authorizing `identity:get_user(user_id=eb7d67c998004d0f9af9980493330f9e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:27.858623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:27.860243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 120/232] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:27 2022] GET /identity/v3/users/eb7d67c998004d0f9af9980493330f9e => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:27.865826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:28.009883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e75b5-f061-4e2c-b362-a246fb889836 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:28.034164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:28.066365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce5e4e-b3b5-4391-903f-c1439ead10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:28.067161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5e4e-b3b5-4391-903f-c1439ead10ab None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:28.067469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5e4e-b3b5-4391-903f-c1439ead10ab None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:28.067744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5e4e-b3b5-4391-903f-c1439ead10ab None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:28.068920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce5e4e-b3b5-4391-903f-c1439ead10ab None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:28.070990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce5e4e-b3b5-4391-903f-c1439ead10ab None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:28.073600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 113/233] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:27 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:28.079601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:28.181394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:28.208963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0106-636a-4ff1-b646-36c14e7e9594 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:28.262111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe42490-839e-4029-85ba-99947a13bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:28.262796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe42490-839e-4029-85ba-99947a13bcf6 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:28.263079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe42490-839e-4029-85ba-99947a13bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:28.263379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe42490-839e-4029-85ba-99947a13bcf6 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/eb7d67c998004d0f9af9980493330f9e/roles/e74e413191434331b30c59872ddd2015` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:28.265674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe42490-839e-4029-85ba-99947a13bcf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee2fa4db020d49458f66a1e5b82688be, user_id=eb7d67c998004d0f9af9980493330f9e, role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:28.267145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe42490-839e-4029-85ba-99947a13bcf6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:28.299611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 121/234] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:28 2022] PUT /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/eb7d67c998004d0f9af9980493330f9e/roles/e74e413191434331b30c59872ddd2015 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:28.702797 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1ed76-3b54-4127-bc44-4b1a10f846e8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:28.703369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1ed76-3b54-4127-bc44-4b1a10f846e8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:28.703369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1ed76-3b54-4127-bc44-4b1a10f846e8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:28.704914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 114/235] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:28.713180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd460b-a3fc-4a46-b145-cf85cfed4911 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:28.713600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd460b-a3fc-4a46-b145-cf85cfed4911 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:28.713773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd460b-a3fc-4a46-b145-cf85cfed4911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:28.718039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9702-fc6d-41a9-b867-a4d13405dbea None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:28.718333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9702-fc6d-41a9-b867-a4d13405dbea None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:28.718613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9702-fc6d-41a9-b867-a4d13405dbea None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:28.720218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 115/236] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:28.736485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-37cd460b-a3fc-4a46-b145-cf85cfed4911 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:28.738010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-37cd460b-a3fc-4a46-b145-cf85cfed4911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:28.742791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5ac9-6cfa-4e73-9f50-a9deb50f7e39 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:28.747302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5ac9-6cfa-4e73-9f50-a9deb50f7e39 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:28.747302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5ac9-6cfa-4e73-9f50-a9deb50f7e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:28.779891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ec8b5ac9-6cfa-4e73-9f50-a9deb50f7e39 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:28.781114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ec8b5ac9-6cfa-4e73-9f50-a9deb50f7e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:28.869201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 122/237] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:28.899532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 116/238] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:28.906710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd460b-a3fc-4a46-b145-cf85cfed4911 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:28.922667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5ac9-6cfa-4e73-9f50-a9deb50f7e39 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:28.995752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:29.054201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd460b-a3fc-4a46-b145-cf85cfed4911 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:29.102942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5ac9-6cfa-4e73-9f50-a9deb50f7e39 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:29.114341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:29.126393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:29.127049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.127357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.127742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.139591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:29.140297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.140587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.140866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.142015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:29.143738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:29.145687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 117/239] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:29.151918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:29.157253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:29.167748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:29.168875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:29.169864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:29.173810 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 123/240] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:29.179508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:29.314458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111469d1-92bc-4318-a3a6-b90759871508 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:29.362613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b7147-cb5d-4bd0-80d3-20e8926b5ea8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:29.388771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80636dee-be47-46e3-a8a6-4ded298903df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:29.389401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636dee-be47-46e3-a8a6-4ded298903df None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.389687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636dee-be47-46e3-a8a6-4ded298903df None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.389962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636dee-be47-46e3-a8a6-4ded298903df None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.390715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80636dee-be47-46e3-a8a6-4ded298903df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:29.392202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80636dee-be47-46e3-a8a6-4ded298903df None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:29.419592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:29.427589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 118/241] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:29 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:29.428853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bf59f-b101-4e23-96da-8a30a198372b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.429148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bf59f-b101-4e23-96da-8a30a198372b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.429431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bf59f-b101-4e23-96da-8a30a198372b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.431931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:29.432741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.433438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.433819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.434891 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:29.435378 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:29.437245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:29.439719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 119/242] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:29.447216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879bc4-f88d-481d-96af-9b9943f687c0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.447591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879bc4-f88d-481d-96af-9b9943f687c0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.447791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879bc4-f88d-481d-96af-9b9943f687c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.460972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 124/243] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:29.468887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:29.495465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e2879bc4-f88d-481d-96af-9b9943f687c0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:29.497061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e2879bc4-f88d-481d-96af-9b9943f687c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:29.545596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:29.620134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 120/244] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:29.644226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879bc4-f88d-481d-96af-9b9943f687c0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:29.665770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35db7a-bd3a-420b-a645-f25ca9ea94c6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:29.714908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:29.716014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.716296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.716833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] PATH_INFO: `/v3/users/3ef01b6e47364bb19531887f07fb48f5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.737577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] RBAC: Authorizing `identity:get_user(user_id=3ef01b6e47364bb19531887f07fb48f5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:29.739055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:29.741135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 125/245] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:29 2022] GET /identity/v3/users/3ef01b6e47364bb19531887f07fb48f5 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:29.748018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:29.797357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879bc4-f88d-481d-96af-9b9943f687c0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:29.810261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:29.836977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:29.837791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.838076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.838355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.850558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:29.858346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:29.859390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:29.860654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 121/246] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:29.866207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:29.878975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b58e4c-2d7a-48b6-807d-55878c26bade None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:29.897691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:29.920797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1fb9-91a3-4024-81e7-2fd32510cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:29.921419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1fb9-91a3-4024-81e7-2fd32510cae0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:29.921697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1fb9-91a3-4024-81e7-2fd32510cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:29.921970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1fb9-91a3-4024-81e7-2fd32510cae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:29.979242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6322-9fae-46dc-9c4d-cebfb7ee05ef None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:30.002360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1fb9-91a3-4024-81e7-2fd32510cae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:30.003985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1fb9-91a3-4024-81e7-2fd32510cae0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:30.017165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fd8a8-47ec-4e10-b75d-c9c2b0195dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:30.017792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd8a8-47ec-4e10-b75d-c9c2b0195dba None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.018071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd8a8-47ec-4e10-b75d-c9c2b0195dba None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.018346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd8a8-47ec-4e10-b75d-c9c2b0195dba None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.019066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fd8a8-47ec-4e10-b75d-c9c2b0195dba None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:30.019405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fd8a8-47ec-4e10-b75d-c9c2b0195dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:30.020800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fd8a8-47ec-4e10-b75d-c9c2b0195dba None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:30.030551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 122/247] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:30.031937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f1c0-3497-4cf2-b8c8-a8c33e719d5d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.032226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f1c0-3497-4cf2-b8c8-a8c33e719d5d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.032506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4f1c0-3497-4cf2-b8c8-a8c33e719d5d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.033980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 123/248] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:30.035894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4f1c0-3497-4cf2-b8c8-a8c33e719d5d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:30.058606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:30.132445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 126/249] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 04:04:30.134952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c116d0-3308-4dc9-bd5e-fd40bc235d95 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.139462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c116d0-3308-4dc9-bd5e-fd40bc235d95 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.140034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c116d0-3308-4dc9-bd5e-fd40bc235d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.155357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:30.165886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-05c116d0-3308-4dc9-bd5e-fd40bc235d95 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:30.167349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-05c116d0-3308-4dc9-bd5e-fd40bc235d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:30.177383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4f1c0-3497-4cf2-b8c8-a8c33e719d5d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:30.241111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 127/250] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:30.242632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c116d0-3308-4dc9-bd5e-fd40bc235d95 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:30.251211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:30.251888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.252166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.252440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] PATH_INFO: `/v3/users/5d11e45f7df14179ab6d48604ca8f3d5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.255130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] RBAC: Authorizing `identity:get_user(user_id=5d11e45f7df14179ab6d48604ca8f3d5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:30.256596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:30.258967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 124/251] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:30 2022] GET /identity/v3/users/5d11e45f7df14179ab6d48604ca8f3d5 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:30.265240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:30.408364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:30.434385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c116d0-3308-4dc9-bd5e-fd40bc235d95 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:30.460567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eeccc-afdc-41ab-b08b-8700c9082829 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:30.489100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:30.491805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.492360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.492997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.495949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:30.498461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:30.500557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 128/252] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:30 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:30.501465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:30.527425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:30.528912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.529704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.530440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.532203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:30.533910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:30.536158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 125/253] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:30 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:30.537133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:30.568992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:30.645876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b580-78f1-4944-95b3-f68b1fabd690 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:30.683876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:30.684948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.685528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.685999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.687014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] RBAC: Adding query filter params (role.id=c35873f04035439aa38ba837a7579bb9, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=3ef01b6e47364bb19531887f07fb48f5) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:30.687649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:30.689398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:30.696211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 126/254] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:30 2022] GET /identity/v3/role_assignments?user.id=3ef01b6e47364bb19531887f07fb48f5&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=c35873f04035439aa38ba837a7579bb9 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:30.702156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:30.742905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1401e-a6ca-4d1b-a8e7-41d431748d68 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:30.780719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:30.781371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:30.781652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:30.781928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:30.793758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:30.799063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:30.800172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:30.801162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:30.807288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 129/255] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:30.810358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:30.832166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:30.876474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:30.907159 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324d61-71ca-47af-b0c0-63060ba007ec None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:31.002194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:31.002857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.003147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.003454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/5d11e45f7df14179ab6d48604ca8f3d5/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.009145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] RBAC: Authorizing `identity:create_grant(project_id=ee2fa4db020d49458f66a1e5b82688be, user_id=5d11e45f7df14179ab6d48604ca8f3d5, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:31.010878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:31.011214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b949b3-f258-40a5-89ea-f81605ec0d8f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:31.045852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 127/256] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:30 2022] PUT /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/5d11e45f7df14179ab6d48604ca8f3d5/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:31.051152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25753fd3-44f1-4cd7-a256-cace17d61bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:31.051815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25753fd3-44f1-4cd7-a256-cace17d61bba None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.052092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25753fd3-44f1-4cd7-a256-cace17d61bba None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.052361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25753fd3-44f1-4cd7-a256-cace17d61bba None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.053082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25753fd3-44f1-4cd7-a256-cace17d61bba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:31.053380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25753fd3-44f1-4cd7-a256-cace17d61bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:31.054841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25753fd3-44f1-4cd7-a256-cace17d61bba None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:31.064979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 130/257] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:31.071424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:31.093417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d09067-b380-4d84-9fe6-0cce4940f2cd None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.093743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d09067-b380-4d84-9fe6-0cce4940f2cd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.094022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d09067-b380-4d84-9fe6-0cce4940f2cd None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.095684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 131/258] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:31.101197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b64c4-1b25-485c-8ef2-271813eab8e7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.102044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b64c4-1b25-485c-8ef2-271813eab8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.102324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b64c4-1b25-485c-8ef2-271813eab8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.132672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a98b64c4-1b25-485c-8ef2-271813eab8e7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:31.134712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a98b64c4-1b25-485c-8ef2-271813eab8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:31.239443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:31.248536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 132/259] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:31.273256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b64c4-1b25-485c-8ef2-271813eab8e7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:31.354101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cce37-1bcc-47b7-9c7b-1a77578d277f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:31.383861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b64c4-1b25-485c-8ef2-271813eab8e7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:31.418765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:31.419446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.419726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.420031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.431316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:31.436833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:31.437819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:31.438673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 133/260] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:31.444071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:31.484601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:31.485278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.485565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.485846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] PATH_INFO: `/v3/users/eb7d67c998004d0f9af9980493330f9e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.487039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=eb7d67c998004d0f9af9980493330f9e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:31.488560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:31.490360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 128/261] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:31 2022] GET /identity/v3/users/eb7d67c998004d0f9af9980493330f9e => generated 283 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:31.500253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:31.546148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:31.568482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:31.655253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3507e-5e2d-4d4d-8c53-af1d8d80dec3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:31.726713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:31.726713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.726713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.726713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.727116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:31.727116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:31.728484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:31.743191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 134/262] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:31.748911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:31.776207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e551-827e-4391-86a0-675dc035b4e4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:31.854253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:31.854800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.855081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.855381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.900945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c210b28-d3e8-44a3-bba0-e523a1883745 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:31.920372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:31.951955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:31.952946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:31.953444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:31.953911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] PATH_INFO: `/v3/users/eb7d67c998004d0f9af9980493330f9e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:31.955340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] RBAC: Authorizing `identity:get_user(user_id=eb7d67c998004d0f9af9980493330f9e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:31.957018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:31.958843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 135/263] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:31 2022] GET /identity/v3/users/eb7d67c998004d0f9af9980493330f9e => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:31.966064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:31.988486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:31.989971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:32.024415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:32.130594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd655-1bde-4dab-a4c4-22e8f900d8ee None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:32.177259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:32.177984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:32.178288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:32.178566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:32.198805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 129/264] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:32.207284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:32.288930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:32.313486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:32.314978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:32.394236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec975-c030-4f35-9eb7-50f1e2e30e61 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:32.418829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:32.425083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 136/265] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 04:04:32.432611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:32.459404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:32.459404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:32.459404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:32.459404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:32.459812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:32.461410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:32.468808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 130/266] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:32 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:32.475385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:32.539449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:32.573926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a43c1-952b-489a-94a5-e21c1faec778 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:32.658747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:32.659496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:32.659783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:32.660058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:32.664660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:32.666685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:32.668786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 137/267] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:32 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:32.674798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:32.699362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b27c7-5010-4566-8ad5-177247651210 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:32.775599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab6714-601c-4fcc-bce6-44833d00a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:32.776329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6714-601c-4fcc-bce6-44833d00a40d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:32.776612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6714-601c-4fcc-bce6-44833d00a40d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:32.776885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6714-601c-4fcc-bce6-44833d00a40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:32.777681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab6714-601c-4fcc-bce6-44833d00a40d None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=eb7d67c998004d0f9af9980493330f9e) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:32.778012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab6714-601c-4fcc-bce6-44833d00a40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:32.787671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab6714-601c-4fcc-bce6-44833d00a40d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:32.797787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 131/268] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:32 2022] GET /identity/v3/role_assignments?user.id=eb7d67c998004d0f9af9980493330f9e&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:32.799151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c937a-0a0a-450c-90db-37a85c22b9fe None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:32.799468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c937a-0a0a-450c-90db-37a85c22b9fe None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:32.799749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c937a-0a0a-450c-90db-37a85c22b9fe None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:32.801188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 132/269] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:32.802908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f124cb-a1ee-40f0-b0ee-e07587fff9c4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:32.807432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395f066-788b-4897-bad7-ac57ba3dcf3b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:32.807715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395f066-788b-4897-bad7-ac57ba3dcf3b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:32.807990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395f066-788b-4897-bad7-ac57ba3dcf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:32.838876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3395f066-788b-4897-bad7-ac57ba3dcf3b None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:32.840125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3395f066-788b-4897-bad7-ac57ba3dcf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:32.845607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58dee0-a2c3-4cda-aa02-b91cad253fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:32.846287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dee0-a2c3-4cda-aa02-b91cad253fac None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:32.846564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dee0-a2c3-4cda-aa02-b91cad253fac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:32.846834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dee0-a2c3-4cda-aa02-b91cad253fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:32.848602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58dee0-a2c3-4cda-aa02-b91cad253fac None admin] RBAC: Adding query filter params (role.id=e74e413191434331b30c59872ddd2015, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=eb7d67c998004d0f9af9980493330f9e) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:32.848968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58dee0-a2c3-4cda-aa02-b91cad253fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:32.855396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58dee0-a2c3-4cda-aa02-b91cad253fac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:32.868293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 138/270] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:32 2022] GET /identity/v3/role_assignments?user.id=eb7d67c998004d0f9af9980493330f9e&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=e74e413191434331b30c59872ddd2015 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:32.949708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:32.984345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 133/271] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:33.033015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c0333-15b1-45de-a5c9-7ba238f06ab1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.033344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c0333-15b1-45de-a5c9-7ba238f06ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.033568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c0333-15b1-45de-a5c9-7ba238f06ab1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.035108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 139/272] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:33.036026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395f066-788b-4897-bad7-ac57ba3dcf3b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:33.042266 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91178a-35f9-424a-88f7-dbda6cc351e1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.042870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91178a-35f9-424a-88f7-dbda6cc351e1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.043376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91178a-35f9-424a-88f7-dbda6cc351e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.065164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5a91178a-35f9-424a-88f7-dbda6cc351e1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:33.066767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5a91178a-35f9-424a-88f7-dbda6cc351e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:33.086731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:33.198170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 140/273] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:33.209177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395f066-788b-4897-bad7-ac57ba3dcf3b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:33.230129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91178a-35f9-424a-88f7-dbda6cc351e1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:33.253890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:33.254807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.255232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.255683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.258386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:33.261033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:33.262918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 134/274] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:33.269384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:33.344907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:33.375120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91178a-35f9-424a-88f7-dbda6cc351e1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:33.403531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fae88-f848-41f5-8ece-7dbb665b35ec None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:33.414112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:33.414993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.415544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.415960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.427917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:33.434518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:33.435776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:33.437012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:33.439376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 141/275] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:33.446830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5405cb2-8cad-4da9-8dff-f211b651d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:33.447493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:33.447630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405cb2-8cad-4da9-8dff-f211b651d098 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.447775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405cb2-8cad-4da9-8dff-f211b651d098 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.448045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405cb2-8cad-4da9-8dff-f211b651d098 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.448758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5405cb2-8cad-4da9-8dff-f211b651d098 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:33.450194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5405cb2-8cad-4da9-8dff-f211b651d098 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:33.460608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:33.476648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 135/276] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:33 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:04:33.579051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7b0c5-1bf6-4b88-b27b-4dab05f97fd2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:33.584615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf401-6dd9-43dd-83b1-1b0cf523b99b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.584979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf401-6dd9-43dd-83b1-1b0cf523b99b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.585325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf401-6dd9-43dd-83b1-1b0cf523b99b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.587600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 136/277] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:33.593708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbe4fd-360b-4bdd-ad29-0fb68f6b67eb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.593708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbe4fd-360b-4bdd-ad29-0fb68f6b67eb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.593978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbe4fd-360b-4bdd-ad29-0fb68f6b67eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.613494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-45fbe4fd-360b-4bdd-ad29-0fb68f6b67eb None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:33.614816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-45fbe4fd-360b-4bdd-ad29-0fb68f6b67eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:33.622039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:33.622954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.623537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.624003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.624898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:33.625363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:33.627125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:33.636792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 142/278] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:33.642829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:33.707348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 137/279] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:33.722649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbe4fd-360b-4bdd-ad29-0fb68f6b67eb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:33.727035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:33.761280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:33.766083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af26f-1de9-4c68-a23e-b52d14bb2e99 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:33.808079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f8900-9829-45a0-a5cc-74561f86afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:33.810024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f8900-9829-45a0-a5cc-74561f86afe9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.810519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f8900-9829-45a0-a5cc-74561f86afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.811197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f8900-9829-45a0-a5cc-74561f86afe9 None admin] PATH_INFO: `/v3/users/fc25b9df45b843d7a647642360e1bff4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.829834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f8900-9829-45a0-a5cc-74561f86afe9 None admin] RBAC: Authorizing `identity:get_user(user_id=fc25b9df45b843d7a647642360e1bff4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:33.831486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f8900-9829-45a0-a5cc-74561f86afe9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:33.833537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 143/280] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:33 2022] GET /identity/v3/users/fc25b9df45b843d7a647642360e1bff4 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:33.834806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da038-6c68-4c18-833e-1246d703a56a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.835090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da038-6c68-4c18-833e-1246d703a56a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.835527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da038-6c68-4c18-833e-1246d703a56a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.837483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 144/281] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:33.840130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370da038-6c68-4c18-833e-1246d703a56a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:33.850519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbe4fd-360b-4bdd-ad29-0fb68f6b67eb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:33.894418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2480a2-e14a-442d-8180-9cdee632caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:33.895073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2480a2-e14a-442d-8180-9cdee632caa4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.895407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2480a2-e14a-442d-8180-9cdee632caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.895682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2480a2-e14a-442d-8180-9cdee632caa4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.909989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2480a2-e14a-442d-8180-9cdee632caa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4e2480a2-e14a-442d-8180-9cdee632caa4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:33.915495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:33.916396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:33.917188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:33.920027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 138/282] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:33.921462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431eb7a-fcf7-4729-aa05-9a25681cacc5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:33.921921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431eb7a-fcf7-4729-aa05-9a25681cacc5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:33.922488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431eb7a-fcf7-4729-aa05-9a25681cacc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:33.947019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9431eb7a-fcf7-4729-aa05-9a25681cacc5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:33.948341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9431eb7a-fcf7-4729-aa05-9a25681cacc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:33.965819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370da038-6c68-4c18-833e-1246d703a56a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:33.997582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:34.008495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:34.009397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:34.009855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:34.011200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:34.012185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, user.id=fc25b9df45b843d7a647642360e1bff4, scope.system=all) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:34.012906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:34.015217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:34.023148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 145/283] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 04:04:33 2022] GET /identity/v3/role_assignments?user.id=fc25b9df45b843d7a647642360e1bff4&scope.system=all&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:34.024760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:34.034897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 139/284] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:34.057606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431eb7a-fcf7-4729-aa05-9a25681cacc5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:34.101572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:34.228220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8be1f8-e77a-45bc-8c16-30d0659a4835 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:34.249027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431eb7a-fcf7-4729-aa05-9a25681cacc5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:34.290020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:34.290969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:34.291432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:34.291854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:34.297344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:34.298066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:34.298447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:34.298725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:34.299473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:34.299779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:34.301156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:34.303971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:34.310100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:34.311211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:34.312249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:34.314977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 140/285] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:34.326190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 146/286] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:34.327491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:34.331922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:34.435820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:34.454308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:34.459121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d38240-8f15-4a09-b258-c36c706ac056 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:34.498026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:34.498646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:34.498926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:34.499278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:34.499949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:34.500403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:34.501789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:34.512220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 141/287] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:34.520432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:34.566855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee743-f7c7-48be-9f5b-eb71c002e8ac None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:34.651491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050254c-58f7-4cc0-9b0e-00a006a248b0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:34.686959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:34.687355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:34.687648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:34.687914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:34.688186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] PATH_INFO: `/v3/users/5d11e45f7df14179ab6d48604ca8f3d5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:34.688998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:34.689348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] RBAC: Authorizing `identity:get_user(user_id=5d11e45f7df14179ab6d48604ca8f3d5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:34.689690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:34.690159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] PATH_INFO: `/v3/users/3ef01b6e47364bb19531887f07fb48f5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:34.690781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:34.692700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 142/288] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:34 2022] GET /identity/v3/users/5d11e45f7df14179ab6d48604ca8f3d5 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:34.697053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] RBAC: Authorizing `identity:get_user(user_id=3ef01b6e47364bb19531887f07fb48f5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:34.698021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:34.699008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:34.700861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 147/289] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:34 2022] GET /identity/v3/users/3ef01b6e47364bb19531887f07fb48f5 => generated 297 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:34.714678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:34.719601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:34.809758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ccf14-09fb-4dfa-80f8-9d9864166698 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:34.846611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:34.847240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:34.847552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:34.847830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:34.921661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:34.923399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:34.938326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:34.990836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0660-0b81-4c86-8446-0470a00170c6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:35.016766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:35.029512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:35.030160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:35.030445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:35.030721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:35.031969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:35.033484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:35.035960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 148/290] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:34 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:35.041603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:35.129850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 143/291] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:35.136959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:35.207909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031e58-5d92-4d4f-914c-b4d6cb6a5fdf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:35.243757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:35.244452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:35.244732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:35.245005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/3ef01b6e47364bb19531887f07fb48f5/roles/c35873f04035439aa38ba837a7579bb9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:35.247512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee2fa4db020d49458f66a1e5b82688be, user_id=3ef01b6e47364bb19531887f07fb48f5, role_id=c35873f04035439aa38ba837a7579bb9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:35.249119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:35.266664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 149/292] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:04:35 2022] PUT /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be/users/3ef01b6e47364bb19531887f07fb48f5/roles/c35873f04035439aa38ba837a7579bb9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:35.329620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6bf1-6c0b-4ca8-bfba-fe8b563dbf4a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:35.351166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:35.385207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32aa50-110a-4164-a74f-cb8065e3d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:35.386500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32aa50-110a-4164-a74f-cb8065e3d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:35.386989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32aa50-110a-4164-a74f-cb8065e3d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:35.387499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32aa50-110a-4164-a74f-cb8065e3d1d9 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:35.392045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32aa50-110a-4164-a74f-cb8065e3d1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:35.393840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32aa50-110a-4164-a74f-cb8065e3d1d9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:35.395934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 144/293] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:35 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:35.402677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:35.476640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:35.536644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d129-49f2-4691-91da-a496f3af7fb0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:35.577953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc0df-cc46-46de-bd3f-7fa20f8a0d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:35.578944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc0df-cc46-46de-bd3f-7fa20f8a0d7d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:35.579456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc0df-cc46-46de-bd3f-7fa20f8a0d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:35.579928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc0df-cc46-46de-bd3f-7fa20f8a0d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:35.580917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc0df-cc46-46de-bd3f-7fa20f8a0d7d None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=5d11e45f7df14179ab6d48604ca8f3d5) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:35.581426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc0df-cc46-46de-bd3f-7fa20f8a0d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:35.583081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc0df-cc46-46de-bd3f-7fa20f8a0d7d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:35.589599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 150/294] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:35 2022] GET /identity/v3/role_assignments?user.id=5d11e45f7df14179ab6d48604ca8f3d5&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:35.940130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce811d9-ca99-4771-8810-f5e9edaebb47 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:35.940499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce811d9-ca99-4771-8810-f5e9edaebb47 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:35.940697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce811d9-ca99-4771-8810-f5e9edaebb47 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:35.942305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 145/295] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:35.947916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988d98-8eb9-4693-ba32-388ea319acce None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:35.948210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988d98-8eb9-4693-ba32-388ea319acce None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:35.948493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988d98-8eb9-4693-ba32-388ea319acce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:35.971652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-39988d98-8eb9-4693-ba32-388ea319acce None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:35.972863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-39988d98-8eb9-4693-ba32-388ea319acce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:36.061651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 151/296] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:36.086350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce811d9-ca99-4771-8810-f5e9edaebb47 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.193063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7600-e179-45dd-9e48-7e146b6b78ed None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.193342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7600-e179-45dd-9e48-7e146b6b78ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.193774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7600-e179-45dd-9e48-7e146b6b78ed None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.200113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 152/297] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:36.200244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce811d9-ca99-4771-8810-f5e9edaebb47 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.202469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bf619-5740-4bea-90b7-706855944c69 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.202967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bf619-5740-4bea-90b7-706855944c69 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.203487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bf619-5740-4bea-90b7-706855944c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.221807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b44bf619-5740-4bea-90b7-706855944c69 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:36.223372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b44bf619-5740-4bea-90b7-706855944c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:36.237611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411c38d-7e26-48e7-ba10-caff808ff077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.238262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c38d-7e26-48e7-ba10-caff808ff077 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.238543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c38d-7e26-48e7-ba10-caff808ff077 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.238815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c38d-7e26-48e7-ba10-caff808ff077 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.249916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411c38d-7e26-48e7-ba10-caff808ff077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8411c38d-7e26-48e7-ba10-caff808ff077 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:36.254880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:36.255847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:36.256683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 146/298] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:36.258676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4101-97ca-4490-b771-f9d909529148 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.258676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4101-97ca-4490-b771-f9d909529148 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.258837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4101-97ca-4490-b771-f9d909529148 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.260233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 147/299] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:36.263145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4101-97ca-4490-b771-f9d909529148 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.275691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:36.303225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 153/300] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:36.304354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559fa9-f2bf-406c-b418-207f0101eb18 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.304841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559fa9-f2bf-406c-b418-207f0101eb18 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.305096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559fa9-f2bf-406c-b418-207f0101eb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.314389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:36.324738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-49559fa9-f2bf-406c-b418-207f0101eb18 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:36.325947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-49559fa9-f2bf-406c-b418-207f0101eb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:36.390387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4101-97ca-4490-b771-f9d909529148 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.408598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 154/301] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:36.409360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559fa9-f2bf-406c-b418-207f0101eb18 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.432384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.433441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.433737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.434035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.434728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:36.435040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:36.436410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:36.445701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 148/302] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:36.446763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.519354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559fa9-f2bf-406c-b418-207f0101eb18 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.521648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:36.545692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:36.548744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df57ed-5b7c-4977-b2e8-050c26bf7106 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.560548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.561181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.561460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.561829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.563092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:36.564664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:36.571066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 155/303] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:36.571066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.587548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.588197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.588481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.588760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.598887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:36.604892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:36.605848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:36.606668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 149/304] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:36.607371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.684683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d925-ccfd-4c53-9fae-0c0f2c3d677d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.720053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8421-607f-4d9e-a30c-04c6f4b20fe5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.722475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.723124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.723450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.723727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] PATH_INFO: `/v3/users/69325f88ef73484b83ac06bea36aee96` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.737900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] RBAC: Authorizing `identity:get_user(user_id=69325f88ef73484b83ac06bea36aee96)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:36.741838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:36.741838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 156/305] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/users/69325f88ef73484b83ac06bea36aee96 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:36.741838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.762384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.763039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.763315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.763597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] PATH_INFO: `/v3/groups` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.764388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:36.765705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:36.777426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:36.795290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 150/306] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Jul 27 04:04:36 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:36.795290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.832715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:36.856500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf9a4-5fbb-4b72-b1f6-72c98133d4b8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.896599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.897383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.897767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.898142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.899123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:36.899628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:36.901100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:36.911704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 157/307] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:36.917919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:36.943752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591cbe-0936-46c8-a8f4-b2cb14d8edcc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:36.996322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:36.997272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:36.997558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:36.997840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:36.998643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] RBAC: Adding query filter params (role.id=c35873f04035439aa38ba837a7579bb9, user.id=69325f88ef73484b83ac06bea36aee96, scope.system=all) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:36.998953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:37.000540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:37.006100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 151/308] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/role_assignments?user.id=69325f88ef73484b83ac06bea36aee96&scope.system=all&role.id=c35873f04035439aa38ba837a7579bb9 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:37.045381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:37.056997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777368a-7f94-4fea-abc6-7ea78b701dd2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:37.097054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ebea9-f5ec-48ad-b4a7-d2452021fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:37.097673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebea9-f5ec-48ad-b4a7-d2452021fbfb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:37.097882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebea9-f5ec-48ad-b4a7-d2452021fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:37.098157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebea9-f5ec-48ad-b4a7-d2452021fbfb None admin] PATH_INFO: `/v3/users/fc25b9df45b843d7a647642360e1bff4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:37.099406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ebea9-f5ec-48ad-b4a7-d2452021fbfb None admin] RBAC: Authorizing `identity:get_user(user_id=fc25b9df45b843d7a647642360e1bff4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:37.100904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ebea9-f5ec-48ad-b4a7-d2452021fbfb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:37.103845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 158/309] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:36 2022] GET /identity/v3/users/fc25b9df45b843d7a647642360e1bff4 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:37.109262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:37.203635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:37.221458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c1fb-9470-4ea5-a8ee-416346ca82e3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:37.257034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b931b-30ec-4de0-aa82-0426dc724573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:37.257783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b931b-30ec-4de0-aa82-0426dc724573 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:37.258066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b931b-30ec-4de0-aa82-0426dc724573 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:37.258346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b931b-30ec-4de0-aa82-0426dc724573 None admin] PATH_INFO: `/v3/system/users/fc25b9df45b843d7a647642360e1bff4/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:37.259846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b931b-30ec-4de0-aa82-0426dc724573 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fc25b9df45b843d7a647642360e1bff4, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:37.261491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b931b-30ec-4de0-aa82-0426dc724573 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:37.272399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 152/310] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Jul 27 04:04:37 2022] PUT /identity/v3/system/users/fc25b9df45b843d7a647642360e1bff4/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:37.617656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53886a-a195-491c-895c-beb5642e4704 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:37.618036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53886a-a195-491c-895c-beb5642e4704 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:37.618236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53886a-a195-491c-895c-beb5642e4704 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:37.619896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 159/311] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:37.625081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6fb1d-ccf2-4429-ac6b-b99fd81c5a10 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:37.625375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6fb1d-ccf2-4429-ac6b-b99fd81c5a10 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:37.625656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6fb1d-ccf2-4429-ac6b-b99fd81c5a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:37.644499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-01b6fb1d-ccf2-4429-ac6b-b99fd81c5a10 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:37.645712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-01b6fb1d-ccf2-4429-ac6b-b99fd81c5a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:37.717184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 153/312] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:37.740167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53886a-a195-491c-895c-beb5642e4704 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:37.854036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53886a-a195-491c-895c-beb5642e4704 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:37.889704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:37.890322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:37.890610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:37.890885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:37.902175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:37.907556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:37.908469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:37.909282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 160/313] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:37.916354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6fb1d-ccf2-4429-ac6b-b99fd81c5a10 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:38.000048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:38.022870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6fb1d-ccf2-4429-ac6b-b99fd81c5a10 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:38.060318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:38.060942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:38.061224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:38.061499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:38.062211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:38.062514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:38.063965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:38.073124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 154/314] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:38.078336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:38.103124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:38.186706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebe1a-f9a3-4abe-9abd-d45dfca89f89 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:38.221958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:38.222668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:38.222953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:38.223227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] PATH_INFO: `/v3/users/3ef01b6e47364bb19531887f07fb48f5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:38.224472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] RBAC: Authorizing `identity:get_user(user_id=3ef01b6e47364bb19531887f07fb48f5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:38.225959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:38.229283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 161/315] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:38 2022] GET /identity/v3/users/3ef01b6e47364bb19531887f07fb48f5 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:38.236485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:38.344070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02eb89-5ea1-495a-9fe6-99a4b29553dd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:38.378917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:38.379801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:38.380229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:38.380677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:38.397717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:38.455671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:38.457364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:38.563307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 155/316] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:38.568704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:38.668156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:38.680813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffb0c6-d98b-4576-bc6e-c8387f924e55 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:38.716180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb33fee-3c8c-4887-ab15-3118a3e5184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:38.716746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb33fee-3c8c-4887-ab15-3118a3e5184b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:38.717030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb33fee-3c8c-4887-ab15-3118a3e5184b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:38.717307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb33fee-3c8c-4887-ab15-3118a3e5184b None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:38.718476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb33fee-3c8c-4887-ab15-3118a3e5184b None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:38.719948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb33fee-3c8c-4887-ab15-3118a3e5184b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:38.721789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 162/317] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:38 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:38.728144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:38.772132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:38.833061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857470a-d76c-4704-b29e-a80eff2f2c84 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:38.869482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44381159-baf9-4a2e-b970-aa653e8250c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:38.870447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44381159-baf9-4a2e-b970-aa653e8250c2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:38.870929 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44381159-baf9-4a2e-b970-aa653e8250c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:38.871543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44381159-baf9-4a2e-b970-aa653e8250c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:38.872534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44381159-baf9-4a2e-b970-aa653e8250c2 None admin] RBAC: Adding query filter params (role.id=c35873f04035439aa38ba837a7579bb9, scope.project.id=ee2fa4db020d49458f66a1e5b82688be, user.id=3ef01b6e47364bb19531887f07fb48f5) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:38.873108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44381159-baf9-4a2e-b970-aa653e8250c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:38.874830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44381159-baf9-4a2e-b970-aa653e8250c2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:38.881718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 156/318] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:04:38 2022] GET /identity/v3/role_assignments?user.id=3ef01b6e47364bb19531887f07fb48f5&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=c35873f04035439aa38ba837a7579bb9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:38.967802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cba2f5-b475-43ba-9afb-bb3a5a1b0ffd None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:38.967990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cba2f5-b475-43ba-9afb-bb3a5a1b0ffd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:38.968263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cba2f5-b475-43ba-9afb-bb3a5a1b0ffd None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:38.969985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 163/319] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:38.975637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637933-72c7-4a94-94c7-e1e3bb5441f7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:38.976269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637933-72c7-4a94-94c7-e1e3bb5441f7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:38.977522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637933-72c7-4a94-94c7-e1e3bb5441f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:38.997949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-26637933-72c7-4a94-94c7-e1e3bb5441f7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:38.999166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-26637933-72c7-4a94-94c7-e1e3bb5441f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:39.075956 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 157/320] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:39.100341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cba2f5-b475-43ba-9afb-bb3a5a1b0ffd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.211958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cba2f5-b475-43ba-9afb-bb3a5a1b0ffd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:39.229996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23b5c-7990-47c1-bb78-ade0eb62567b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.230206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23b5c-7990-47c1-bb78-ade0eb62567b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.230659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23b5c-7990-47c1-bb78-ade0eb62567b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.232063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 158/321] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:39.236893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0e914-801c-43ee-868d-5d9e0c28b2df None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.237764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0e914-801c-43ee-868d-5d9e0c28b2df None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.238040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0e914-801c-43ee-868d-5d9e0c28b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.246754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:39.247428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.247714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.247987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.249126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:39.250600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:39.256549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 164/322] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:39.259087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.261674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6dc0e914-801c-43ee-868d-5d9e0c28b2df None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:39.262853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6dc0e914-801c-43ee-868d-5d9e0c28b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:39.285295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:39.292252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:39.335104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 159/323] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:39.357933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0e914-801c-43ee-868d-5d9e0c28b2df None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.366760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de9d20-3fbe-498a-b0a3-e88603317e85 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:39.404279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430274-f47a-4dc8-ae8c-a373558c175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:39.404897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430274-f47a-4dc8-ae8c-a373558c175f None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.405180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430274-f47a-4dc8-ae8c-a373558c175f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.405453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430274-f47a-4dc8-ae8c-a373558c175f None admin] PATH_INFO: `/v3/groups` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.406131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430274-f47a-4dc8-ae8c-a373558c175f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:39.407568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430274-f47a-4dc8-ae8c-a373558c175f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:39.432356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 165/324] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Jul 27 04:04:39 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:04:39.451895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8184d-f5d2-4c5a-abaf-bcff1db5e408 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.452243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8184d-f5d2-4c5a-abaf-bcff1db5e408 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.452623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8184d-f5d2-4c5a-abaf-bcff1db5e408 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.454445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 166/325] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:39.460787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6aa4-7555-42d5-9ef9-e79eb8f858f1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.461080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6aa4-7555-42d5-9ef9-e79eb8f858f1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.461579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b6aa4-7555-42d5-9ef9-e79eb8f858f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.471443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0e914-801c-43ee-868d-5d9e0c28b2df None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:39.481802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-552b6aa4-7555-42d5-9ef9-e79eb8f858f1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:39.484548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-552b6aa4-7555-42d5-9ef9-e79eb8f858f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:39.513531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:39.514329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.514614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.514892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.528355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:39.533957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:39.534915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:39.536257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 160/326] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:39.541943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.571187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:39.574702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 167/327] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:39.598207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6aa4-7555-42d5-9ef9-e79eb8f858f1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.615345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:39.661916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db70dd-edf9-48f3-a30e-358d95bec7d3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:39.704976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:39.705614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.705896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.706175 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.706907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:39.707215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:39.708649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:39.720672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 161/328] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:39.723527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b6aa4-7555-42d5-9ef9-e79eb8f858f1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:39.729557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.768621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:39.769268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.769547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.769823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.782989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:39.790729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:39.791689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:39.792507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 168/329] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:39.797441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.842507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:39.864761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468a01-4015-4394-9e47-502db152dd60 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:39.895332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:39.910478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:39.911593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.912081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.912556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] PATH_INFO: `/v3/users/69325f88ef73484b83ac06bea36aee96` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.914492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] RBAC: Authorizing `identity:get_user(user_id=69325f88ef73484b83ac06bea36aee96)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:39.916182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:39.918042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 162/330] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:39 2022] GET /identity/v3/users/69325f88ef73484b83ac06bea36aee96 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:39.928248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:39.941598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504522c6-e86e-4cdc-9de7-c9d29d2c4424 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:39.983095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:39.983758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:39.984563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:39.984563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:39.985161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:39.985468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:39.987249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:40.003498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 169/331] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:40.005174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:40.073127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24864b-fe72-49a9-8f7a-41270d29cd9a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:40.112377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:40.113094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:40.113381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:40.113658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] PATH_INFO: `/v3/system/users/69325f88ef73484b83ac06bea36aee96/roles/c35873f04035439aa38ba837a7579bb9` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:40.115121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=69325f88ef73484b83ac06bea36aee96, role_id=c35873f04035439aa38ba837a7579bb9)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:40.116551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:40.128880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 163/332] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Jul 27 04:04:39 2022] PUT /identity/v3/system/users/69325f88ef73484b83ac06bea36aee96/roles/c35873f04035439aa38ba837a7579bb9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:40.138862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388dda-378f-42af-aa76-9a2c398bae07 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:40.181150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ae92-83ae-4ea0-ae92-c36a180f9455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:40.181881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ae92-83ae-4ea0-ae92-c36a180f9455 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:40.182166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ae92-83ae-4ea0-ae92-c36a180f9455 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:40.182447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ae92-83ae-4ea0-ae92-c36a180f9455 None admin] PATH_INFO: `/v3/users/fc25b9df45b843d7a647642360e1bff4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:40.184144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82ae92-83ae-4ea0-ae92-c36a180f9455 None admin] RBAC: Authorizing `identity:get_user(user_id=fc25b9df45b843d7a647642360e1bff4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:40.185677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82ae92-83ae-4ea0-ae92-c36a180f9455 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:40.187940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 170/333] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:40 2022] GET /identity/v3/users/fc25b9df45b843d7a647642360e1bff4 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:40.193936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:40.217784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:40.312178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ff326-5f1c-4d08-8535-da8789a82e57 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:40.348745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aef16-1c96-45bd-8ac6-c8ef7883e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:40.349420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aef16-1c96-45bd-8ac6-c8ef7883e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:40.349706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aef16-1c96-45bd-8ac6-c8ef7883e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:40.349982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aef16-1c96-45bd-8ac6-c8ef7883e3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:40.350839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aef16-1c96-45bd-8ac6-c8ef7883e3d7 None admin] RBAC: Adding query filter params (role.id=754e311d9d2c401189da910d6d3bfe01, user.id=fc25b9df45b843d7a647642360e1bff4, scope.system=all) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:40.351220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aef16-1c96-45bd-8ac6-c8ef7883e3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:40.352749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aef16-1c96-45bd-8ac6-c8ef7883e3d7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:40.365446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 164/334] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 04:04:40 2022] GET /identity/v3/role_assignments?user.id=fc25b9df45b843d7a647642360e1bff4&scope.system=all&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:42.313211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31eae5-a113-4105-a720-c9a99e4521c0 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.314077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31eae5-a113-4105-a720-c9a99e4521c0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.314529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31eae5-a113-4105-a720-c9a99e4521c0 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.316501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 171/335] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:42.332992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be522cc-6894-47d0-9a2c-022e159e5c13 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.333942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be522cc-6894-47d0-9a2c-022e159e5c13 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.334446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be522cc-6894-47d0-9a2c-022e159e5c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.349213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77712f57-551c-4fd7-a2ca-293639e6fa9c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.349808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77712f57-551c-4fd7-a2ca-293639e6fa9c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.350298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77712f57-551c-4fd7-a2ca-293639e6fa9c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.352672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 172/336] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:42.359160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de3aa-c212-4a56-a2ca-3279651bb5d5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.359756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de3aa-c212-4a56-a2ca-3279651bb5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.360223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de3aa-c212-4a56-a2ca-3279651bb5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.364258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3be522cc-6894-47d0-9a2c-022e159e5c13 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:42.365469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3be522cc-6894-47d0-9a2c-022e159e5c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:42.375902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:42.396219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b52de3aa-c212-4a56-a2ca-3279651bb5d5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:42.397722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b52de3aa-c212-4a56-a2ca-3279651bb5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:42.484135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 165/337] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:42.509836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 173/338] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:42.530305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be522cc-6894-47d0-9a2c-022e159e5c13 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:42.538966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:42.560019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52de3aa-c212-4a56-a2ca-3279651bb5d5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:42.675698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be522cc-6894-47d0-9a2c-022e159e5c13 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:42.729440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0f891-cefc-4dcd-960d-89937952bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:42.729440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0f891-cefc-4dcd-960d-89937952bf92 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.729440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0f891-cefc-4dcd-960d-89937952bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.729440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0f891-cefc-4dcd-960d-89937952bf92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.745276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0f891-cefc-4dcd-960d-89937952bf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:42.751638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52de3aa-c212-4a56-a2ca-3279651bb5d5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d3e0f891-cefc-4dcd-960d-89937952bf92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:42.753557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:42.754475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:42.755493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 166/339] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:42.756395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b8ecd-e518-4d14-bd15-ca11299c625a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.756825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b8ecd-e518-4d14-bd15-ca11299c625a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.757348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b8ecd-e518-4d14-bd15-ca11299c625a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.758819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 167/340] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:42.768289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b8ecd-e518-4d14-bd15-ca11299c625a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:42.799294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7c3df-3f24-4820-a2cc-06e0b03e283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:42.800268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c3df-3f24-4820-a2cc-06e0b03e283a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.800728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c3df-3f24-4820-a2cc-06e0b03e283a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.801183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c3df-3f24-4820-a2cc-06e0b03e283a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.803289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:42.815161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7c3df-3f24-4820-a2cc-06e0b03e283a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-dda7c3df-3f24-4820-a2cc-06e0b03e283a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:42.821586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:42.822642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:42.823560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:42.826017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 174/341] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:42.827504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ee5fa-9a20-4aa2-901f-36c3c86b6257 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.827970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ee5fa-9a20-4aa2-901f-36c3c86b6257 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.828422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ee5fa-9a20-4aa2-901f-36c3c86b6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.847891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:42.849731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-455ee5fa-9a20-4aa2-901f-36c3c86b6257 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:42.851217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-455ee5fa-9a20-4aa2-901f-36c3c86b6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:42.890165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b8ecd-e518-4d14-bd15-ca11299c625a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:42.924865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 175/342] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:42.926649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f06e0-ffd9-4bf9-906c-185582f26457 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.927117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f06e0-ffd9-4bf9-906c-185582f26457 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.927586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f06e0-ffd9-4bf9-906c-185582f26457 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.929024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 176/343] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:42.929987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f06e0-ffd9-4bf9-906c-185582f26457 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:42.934025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d658-e530-4dbf-95e8-4e3860080625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:42.934759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d658-e530-4dbf-95e8-4e3860080625 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.935242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d658-e530-4dbf-95e8-4e3860080625 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.935764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d658-e530-4dbf-95e8-4e3860080625 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.936664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d658-e530-4dbf-95e8-4e3860080625 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:42.937167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d658-e530-4dbf-95e8-4e3860080625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:42.938729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d658-e530-4dbf-95e8-4e3860080625 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:42.953897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 168/344] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:42.955534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805e5bb-85e2-4484-a131-02d582eab1c6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:42.955998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805e5bb-85e2-4484-a131-02d582eab1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:42.956469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805e5bb-85e2-4484-a131-02d582eab1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:42.984772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b805e5bb-85e2-4484-a131-02d582eab1c6 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:42.986350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b805e5bb-85e2-4484-a131-02d582eab1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:43.040794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f06e0-ffd9-4bf9-906c-185582f26457 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.064598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.073683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 169/345] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:43.075215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805e5bb-85e2-4484-a131-02d582eab1c6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.077254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.078091 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.078595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.079044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.080043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:43.080526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:43.082196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:43.094729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 177/346] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:43.095938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.153264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.198602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805e5bb-85e2-4484-a131-02d582eab1c6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.237051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c11d-5ff0-4e4b-9788-0e33c3d70d48 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.237862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.238488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.238763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.239034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.276316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.277592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.278298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.278833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.293354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:43.300056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:43.301046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 04:04:43.301888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:43.305137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 178/347] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:43.306407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.329844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:43.332110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:43.366269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.410878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.440295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58995fe-23cd-4fb8-8592-6aab9202d7f8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.461511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 170/348] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:43.462334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.479534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.480457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.480918 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.481332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.560155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:43.561871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:43.572636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8c54-ff5e-43c6-8e12-47b622969eb5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.609254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.609913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.610212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.610623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.614666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.622140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:43.627327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:43.628443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:43.629533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 171/349] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:43.630242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.651092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.684126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 179/350] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:43.685479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.744640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1785d2-012b-4e4b-bfb7-06d4b5d026b1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.783107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.783768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.784059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.784335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.785058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:43.785365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:43.786758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:43.797535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c410-3550-4d04-aed5-e75b54f0a257 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.797700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 172/351] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:43.798230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.834378 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.835024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.835339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.836337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.837540 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:43.838993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:43.840706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 180/352] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:43.841560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.857446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.888441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:43.911621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620b70-1345-4241-86c2-8ea6b5543c61 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.949640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.950266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.950550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.950829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.951643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df8075-833f-4864-b9cb-fc3c6338b225 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:43.951754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:43.951946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:43.953397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:43.964012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 173/353] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:43.964968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:43.989614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:43.990263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:43.990541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:43.990812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:43.993139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:43.994861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:43.996694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 181/354] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:43.997376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:44.089393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdaffd-545a-469e-96a1-791cad7f4054 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:44.110445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:44.134802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:44.135732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.136010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.136140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91ffb-321e-4c2a-9718-94e9d68ac9ac None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:44.136309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] PATH_INFO: `/v3/users/69325f88ef73484b83ac06bea36aee96` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.137637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=69325f88ef73484b83ac06bea36aee96)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:44.139339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:44.140778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 174/355] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/users/69325f88ef73484b83ac06bea36aee96 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:44.141635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:44.156921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:44.178582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:44.179295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.179581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.179860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.188263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:44.189729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:44.191699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 182/356] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:43 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:44.194552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:44.270158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a2cc5-9c6a-42b5-9c94-956e14354ac7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:44.311676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:44.312305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.312588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.312860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.316781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951ecb6-dedc-4040-8843-30c9fe2f3dff None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:44.355990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cd18e-ef8f-4115-aab8-712bf49b1c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:44.356644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd18e-ef8f-4115-aab8-712bf49b1c8c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.356923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd18e-ef8f-4115-aab8-712bf49b1c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.357199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd18e-ef8f-4115-aab8-712bf49b1c8c None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.359305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cd18e-ef8f-4115-aab8-712bf49b1c8c None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:44.359901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cd18e-ef8f-4115-aab8-712bf49b1c8c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:44.361795 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 183/357] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:44 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:44.362717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04dcf7-8e16-453f-aef9-cabdf8221bc7 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.363054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04dcf7-8e16-453f-aef9-cabdf8221bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.363364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04dcf7-8e16-453f-aef9-cabdf8221bc7 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.364725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 184/358] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:44.365728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d093-e728-467a-a579-deb11c3c1b95 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.366014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d093-e728-467a-a579-deb11c3c1b95 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.366293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d093-e728-467a-a579-deb11c3c1b95 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.368361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 185/359] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:44.368898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4d093-e728-467a-a579-deb11c3c1b95 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:44.390068 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:44.403393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:44.405077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:44.418135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:44.493746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4d093-e728-467a-a579-deb11c3c1b95 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:44.531495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 175/360] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:44.532152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:44.541097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:44.541732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.542020 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.542300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.543104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] RBAC: Adding query filter params (role.id=c35873f04035439aa38ba837a7579bb9, user.id=69325f88ef73484b83ac06bea36aee96, scope.system=all) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:44.543480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:44.544935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:44.559028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 186/361] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 04:04:44 2022] GET /identity/v3/role_assignments?user.id=69325f88ef73484b83ac06bea36aee96&scope.system=all&role.id=c35873f04035439aa38ba837a7579bb9 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:44.559910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:44.669479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00e7d-5833-49c1-8b7e-b9136062ae64 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:44.677543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:44.686815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:44.723996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4b8c2-fc92-4844-af01-257615f06996 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:44.730955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60dcc2-00f6-45ec-bf8d-c29f41b4d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:44.731613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60dcc2-00f6-45ec-bf8d-c29f41b4d16d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.731892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60dcc2-00f6-45ec-bf8d-c29f41b4d16d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.732645 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60dcc2-00f6-45ec-bf8d-c29f41b4d16d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.733459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60dcc2-00f6-45ec-bf8d-c29f41b4d16d None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=e74e413191434331b30c59872ddd2015, scope.project.id=cb483f0975a64603b7294f5ce29aa037) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:44.733806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60dcc2-00f6-45ec-bf8d-c29f41b4d16d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:44.735694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60dcc2-00f6-45ec-bf8d-c29f41b4d16d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:44.743452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 176/362] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:44 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=e74e413191434331b30c59872ddd2015 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:44.745157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fcf6a-3997-487a-b0ed-751fef6146c2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.745157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fcf6a-3997-487a-b0ed-751fef6146c2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.745396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fcf6a-3997-487a-b0ed-751fef6146c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.765508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9d3fcf6a-3997-487a-b0ed-751fef6146c2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:44.766750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9d3fcf6a-3997-487a-b0ed-751fef6146c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:44.785931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56859dcd-03ad-4cae-99e4-b081e2bba75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:44.786489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859dcd-03ad-4cae-99e4-b081e2bba75c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.786777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859dcd-03ad-4cae-99e4-b081e2bba75c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.787158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56859dcd-03ad-4cae-99e4-b081e2bba75c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.787999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859dcd-03ad-4cae-99e4-b081e2bba75c None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=cb483f0975a64603b7294f5ce29aa037) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:44.788310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859dcd-03ad-4cae-99e4-b081e2bba75c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:44.789852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56859dcd-03ad-4cae-99e4-b081e2bba75c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:44.796658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 187/363] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:44 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:44.798043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8706c-1712-45eb-8fd9-304d87cb8ea2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:44.798335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8706c-1712-45eb-8fd9-304d87cb8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:44.798617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8706c-1712-45eb-8fd9-304d87cb8ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:44.822397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c0b8706c-1712-45eb-8fd9-304d87cb8ea2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:44.823934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c0b8706c-1712-45eb-8fd9-304d87cb8ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:44.872604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 177/364] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:44.873826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fcf6a-3997-487a-b0ed-751fef6146c2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:44.911849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 188/365] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:44.914947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8706c-1712-45eb-8fd9-304d87cb8ea2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.015648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:45.025896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fcf6a-3997-487a-b0ed-751fef6146c2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.028488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:45.052739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8706c-1712-45eb-8fd9-304d87cb8ea2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.065553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.066444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.067022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.067543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.069006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:45.072570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:45.074894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 178/366] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:44 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:45.075995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.091121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.091634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.091915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.092192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.103249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:45.108943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:45.109899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:45.110714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 189/367] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:45.111465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.195742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736f076-4efa-4d81-ab6c-94df0a7c84b7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.227850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a64186-c58a-42e1-89fd-b299c6cee5ae None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.237562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.238560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.239066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.239592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.254120 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:45.260072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:45.261278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:45.262089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:45.264561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 179/368] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:45.265592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.265771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.266499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.266785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.267057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.272634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:45.274427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:45.276100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 190/369] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:45.276651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:45.278040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.304050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:45.398847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc60446-7098-4df5-9f98-bc5fbc3d861f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.417670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d21fb6-976f-4a8a-8869-9b04aeb3e726 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.443054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.444158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.444543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.444970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.445878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:45.446282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:45.448707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:45.460080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 180/370] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:45.461709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.463224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.463879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.464162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.464440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.465166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:45.465471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:45.466853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:45.479113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 191/371] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:45.480017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.549574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:45.599609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:45.606285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a8229-6b6e-4ab3-8b45-f24d727b8d52 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.610522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1026b27-dfb4-447f-b5ba-86e29642a1dc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.645427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.646158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.646504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.646890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.658400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.659122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.659961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.660325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.661226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=ee2fa4db020d49458f66a1e5b82688be) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:45.661997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:45.664436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:45.672230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 181/372] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:45.672917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.744796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:45.746366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:45.812158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:45.825594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17636c-1563-4ed6-b9d6-5b9971a8db05 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:45.874509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 192/373] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:45.880666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:45.890693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:45.892499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:45.892783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:45.893105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:45.949164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:46.000414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:46.001589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:46.071357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f05e-5238-4d84-880f-288d1c5a5b73 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:46.122904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:46.123932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:46.125022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:46.125535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:46.126916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:46.128908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:46.131086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 193/374] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:46.143031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:46.183665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:46.217931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 182/375] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:46.224284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:46.291603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83d6a-70e2-4742-99c5-e96c5e4ca36a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:46.337294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:46.338410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:46.339001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:46.339509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:46.340903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:46.342781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:46.344859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:46.345558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 194/376] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:46 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:46.351753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:46.439899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09963d8-aea3-4d50-b226-94a98fe6f11d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:46.523041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:46.524160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:46.524988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:46.525109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:46.525396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] PATH_INFO: `/v3/projects/fe087670259b408d800e85991f04fa29` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:46.526642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] RBAC: Authorizing `identity:get_project(project_id=fe087670259b408d800e85991f04fa29)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:46.528351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:46.530559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 183/377] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:46 2022] GET /identity/v3/projects/fe087670259b408d800e85991f04fa29 => generated 344 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:46.532748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14db9f-d186-4a49-9614-d2102e1cfed9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:46.535901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:46.582963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:46.583617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:46.583899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:46.584174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:46.584966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=e74e413191434331b30c59872ddd2015, scope.project.id=ee2fa4db020d49458f66a1e5b82688be) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:46.585277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:46.586848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:46.601871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 195/378] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:46 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=e74e413191434331b30c59872ddd2015 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:46.693993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945dc2f-2d66-4b32-b20a-7c49410bb6da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:46.722721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:46.736949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426f0a6-f1c2-44cd-bea8-0fb29f3f462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:46.737620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f0a6-f1c2-44cd-bea8-0fb29f3f462f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:46.737913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f0a6-f1c2-44cd-bea8-0fb29f3f462f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:46.738201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f0a6-f1c2-44cd-bea8-0fb29f3f462f None admin] PATH_INFO: `/v3/groups/33f96f895c0344f5ad48f6c752b040b3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:46.748624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426f0a6-f1c2-44cd-bea8-0fb29f3f462f None admin] RBAC: Authorizing `identity:get_group(group_id=33f96f895c0344f5ad48f6c752b040b3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:46.750117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426f0a6-f1c2-44cd-bea8-0fb29f3f462f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:46.752186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 184/379] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:46 2022] GET /identity/v3/groups/33f96f895c0344f5ad48f6c752b040b3 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:46.761077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:46.874636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2146fa-56d2-4c94-90fe-11eec658a4a2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:46.918457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268d2db-8163-44e2-9ada-9b2576542616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:46.919097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268d2db-8163-44e2-9ada-9b2576542616 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:46.919408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268d2db-8163-44e2-9ada-9b2576542616 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:46.919689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268d2db-8163-44e2-9ada-9b2576542616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:46.920488 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268d2db-8163-44e2-9ada-9b2576542616 None admin] RBAC: Adding query filter params (group.id=33f96f895c0344f5ad48f6c752b040b3, role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=fe087670259b408d800e85991f04fa29) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:46.920804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268d2db-8163-44e2-9ada-9b2576542616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:46.922263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268d2db-8163-44e2-9ada-9b2576542616 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:46.928735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 196/380] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:46 2022] GET /identity/v3/role_assignments?group.id=33f96f895c0344f5ad48f6c752b040b3&scope.project.id=fe087670259b408d800e85991f04fa29&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:47.322179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933e49-5582-4ea6-9bf9-d301eb2d2e35 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:47.322571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933e49-5582-4ea6-9bf9-d301eb2d2e35 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:47.322754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933e49-5582-4ea6-9bf9-d301eb2d2e35 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:47.324412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 185/381] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:47.329709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46c11-4767-4fc5-8125-0028a88cc089 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:47.329999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46c11-4767-4fc5-8125-0028a88cc089 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:47.330283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46c11-4767-4fc5-8125-0028a88cc089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:47.353522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ecd46c11-4767-4fc5-8125-0028a88cc089 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:47.355234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ecd46c11-4767-4fc5-8125-0028a88cc089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:47.370405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:47.436989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 197/382] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:47.464327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a933e49-5582-4ea6-9bf9-d301eb2d2e35 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:47.588616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a933e49-5582-4ea6-9bf9-d301eb2d2e35 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:47.632936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ddf78-a19a-4b63-a3bf-7195f75d8218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:47.633601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ddf78-a19a-4b63-a3bf-7195f75d8218 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:47.633884 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ddf78-a19a-4b63-a3bf-7195f75d8218 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:47.634163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ddf78-a19a-4b63-a3bf-7195f75d8218 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:47.645837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ddf78-a19a-4b63-a3bf-7195f75d8218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f66ddf78-a19a-4b63-a3bf-7195f75d8218 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:47.655218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:47.656221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:47.657512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 186/383] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:47.662355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd46c11-4767-4fc5-8125-0028a88cc089 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:47.685449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929943c3-3314-47dd-8d17-25c90b3fb2c1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:47.685771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929943c3-3314-47dd-8d17-25c90b3fb2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:47.686015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929943c3-3314-47dd-8d17-25c90b3fb2c1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:47.687601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 187/384] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:47.696479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6f76-1df1-4cb6-898f-b7f9f4d7d13e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:47.696798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6f76-1df1-4cb6-898f-b7f9f4d7d13e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:47.697432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6f76-1df1-4cb6-898f-b7f9f4d7d13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:47.743973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5a4a6f76-1df1-4cb6-898f-b7f9f4d7d13e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:47.745176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5a4a6f76-1df1-4cb6-898f-b7f9f4d7d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:47.847678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:47.854490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd46c11-4767-4fc5-8125-0028a88cc089 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:47.897168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 188/385] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:47.909379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:47.910014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:47.910303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:47.910582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:47.911329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:47.911644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:47.913046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:47.922277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 198/386] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:47.927560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6f76-1df1-4cb6-898f-b7f9f4d7d13e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:47.939641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:47.967487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:48.078244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6db5c-a1f9-4827-b075-9d3c9db45d72 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.114552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6f76-1df1-4cb6-898f-b7f9f4d7d13e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.118293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022d57d-4eee-468d-b1ea-f1915555fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.118944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022d57d-4eee-468d-b1ea-f1915555fb15 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.119228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022d57d-4eee-468d-b1ea-f1915555fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.119535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022d57d-4eee-468d-b1ea-f1915555fb15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.142607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022d57d-4eee-468d-b1ea-f1915555fb15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c022d57d-4eee-468d-b1ea-f1915555fb15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:48.151333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:48.152280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:48.153090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:48.155498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 199/387] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:48.157032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159338-c4b2-472c-a127-3a104da20002 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.157528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159338-c4b2-472c-a127-3a104da20002 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.158008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159338-c4b2-472c-a127-3a104da20002 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.159941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 200/388] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:48.164019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159338-c4b2-472c-a127-3a104da20002 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.178170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bf197-9da0-4c34-8c35-e0aa1b1d4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.178822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bf197-9da0-4c34-8c35-e0aa1b1d4f4a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.179101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bf197-9da0-4c34-8c35-e0aa1b1d4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.179526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bf197-9da0-4c34-8c35-e0aa1b1d4f4a None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.180940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bf197-9da0-4c34-8c35-e0aa1b1d4f4a None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.182366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bf197-9da0-4c34-8c35-e0aa1b1d4f4a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.184310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 189/389] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:47 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:48.185431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d67c-6bf9-40af-9e9a-adbe5b970387 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.185709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d67c-6bf9-40af-9e9a-adbe5b970387 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.185977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d67c-6bf9-40af-9e9a-adbe5b970387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.205587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9ce7d67c-6bf9-40af-9e9a-adbe5b970387 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:48.206759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9ce7d67c-6bf9-40af-9e9a-adbe5b970387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:48.244472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:48.261988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:48.280702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159338-c4b2-472c-a127-3a104da20002 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.289730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 190/390] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:48.289909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7d67c-6bf9-40af-9e9a-adbe5b970387 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.337815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.338890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.339446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.340005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.340966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:48.342294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.344678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.357973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 201/391] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:48.359781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.419645 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7d67c-6bf9-40af-9e9a-adbe5b970387 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.458666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.459408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.459694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.459964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.461825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.463277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.465100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 191/392] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:48.465809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.477252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5369a-04fa-4a74-ae72-321f39bded65 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.513612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.514622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.515179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.515676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.517805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:48.520398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:48.530356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:48.535608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:48.536517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:48.537342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:48.545260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 202/393] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:48.546585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.583747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70126f19-c055-4b77-b415-7cde45219b35 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.621997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.622664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.622898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.623219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.624451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.625881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.627953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 192/394] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:48.633254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.653998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f474b-e6f4-484b-ad9f-a44f5de91e9d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.690927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.692524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.693014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.693516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/e74e413191434331b30c59872ddd2015` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.696025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] RBAC: Authorizing `identity:create_grant(project_id=cb483f0975a64603b7294f5ce29aa037, group_id=ebcee4c9cbb9448eaa725f11babd29fc, role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.697710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.717516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 203/395] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 04:04:48 2022] PUT /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/e74e413191434331b30c59872ddd2015 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:48.718821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.747856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec4ad-c3db-466c-ab3c-a6050a470f2c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.763781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:48.787689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.789250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.789979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.790478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.791456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:48.791967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.793675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.797369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:48.804466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 193/396] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:48.810529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.875021 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bf505-3786-4255-a02b-dc0afb3f045c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.918153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.919167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.919682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.920160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.921755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.923596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.925584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 204/397] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:48.927036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7ce8-353b-45a9-b3a8-54c08fb170b2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:48.933074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:48.979006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:48.979612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:48.979893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:48.980168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:48.981380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:48.982842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:48.984590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 194/398] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:48.993446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:49.056886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:49.083703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a77b8-5572-4255-86c0-0454a7b85677 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:49.112677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:49.126449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:49.127168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.127538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.127755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.129698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb483f0975a64603b7294f5ce29aa037, group_id=ebcee4c9cbb9448eaa725f11babd29fc, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:49.131134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:49.140938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29265b91-6f72-4d4c-9f68-36a7f26cf995 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:49.161859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 205/399] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 04:04:48 2022] PUT /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:49.183035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d1091-9c45-403d-a255-a4aaca590ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:49.184126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d1091-9c45-403d-a255-a4aaca590ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.184632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d1091-9c45-403d-a255-a4aaca590ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.185112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d1091-9c45-403d-a255-a4aaca590ca1 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.186709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d1091-9c45-403d-a255-a4aaca590ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:49.188489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d1091-9c45-403d-a255-a4aaca590ca1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:49.194887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 195/400] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:48 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:49.197675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:49.312954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcb4f3-0fcf-40fd-8e92-2ee55e02bba2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:49.353141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3458e3-0a1e-4d95-8ebc-330848c7a2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:49.354200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3458e3-0a1e-4d95-8ebc-330848c7a2de None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.354684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3458e3-0a1e-4d95-8ebc-330848c7a2de None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.355185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3458e3-0a1e-4d95-8ebc-330848c7a2de None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.357778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3458e3-0a1e-4d95-8ebc-330848c7a2de None admin] RBAC: Authorizing `identity:create_grant(project_id=ee2fa4db020d49458f66a1e5b82688be, group_id=ebcee4c9cbb9448eaa725f11babd29fc, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:49.359588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3458e3-0a1e-4d95-8ebc-330848c7a2de None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:49.383373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 206/401] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 04:04:49 2022] PUT /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:04:49.530061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a586f9-60e3-42b0-b79a-41a5820b3622 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.530451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a586f9-60e3-42b0-b79a-41a5820b3622 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.530638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a586f9-60e3-42b0-b79a-41a5820b3622 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.532318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 196/402] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:49.538037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0d64-8112-4b8b-bbc9-5276dc23b342 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.538313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0d64-8112-4b8b-bbc9-5276dc23b342 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.538746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0d64-8112-4b8b-bbc9-5276dc23b342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.559065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d2ce0d64-8112-4b8b-bbc9-5276dc23b342 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:49.560636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d2ce0d64-8112-4b8b-bbc9-5276dc23b342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:49.573150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38e631-4225-4357-8f43-aba7eb7e6a84 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.573430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38e631-4225-4357-8f43-aba7eb7e6a84 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.573629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38e631-4225-4357-8f43-aba7eb7e6a84 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.575102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 197/403] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:49.580454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66770c-3ee4-412b-9c8b-d3ae4ecf3b62 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.580786 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66770c-3ee4-412b-9c8b-d3ae4ecf3b62 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.581067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66770c-3ee4-412b-9c8b-d3ae4ecf3b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.600267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4f66770c-3ee4-412b-9c8b-d3ae4ecf3b62 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:49.602112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4f66770c-3ee4-412b-9c8b-d3ae4ecf3b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:49.606532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:49.643555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 207/404] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:49.680914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 198/405] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:49.688555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0d64-8112-4b8b-bbc9-5276dc23b342 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:49.784262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66770c-3ee4-412b-9c8b-d3ae4ecf3b62 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:49.839296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0d64-8112-4b8b-bbc9-5276dc23b342 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:49.861934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:49.908668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:49.910470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:49.911963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:49.912445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:49.930729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:49.936049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:49.936953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:49.937781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:49.940419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 208/406] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:49.946336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:49.974344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66770c-3ee4-412b-9c8b-d3ae4ecf3b62 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.005274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:50.036853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.037515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.037794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.038067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.057156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:50.062129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:50.063157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:50.064011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:50.071788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 199/407] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:50.084351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429cfd-daf4-411c-adcd-436de6067118 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.088620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:50.125577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.126590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.127157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.127663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.128700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:50.129256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.130841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:50.141272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 209/408] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:50.146430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:50.261850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:50.270718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c3785-3ad4-4cb0-9b72-e5d96b234658 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.300189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef414-2ceb-486b-a75a-99a1ff2796bc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.301834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:50.313249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.314562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.315051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.315855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.317261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.318953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:50.321652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 210/409] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:50 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:50.332285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:50.353369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.353995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.354273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.354545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.355247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:50.359390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.359390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:50.367044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 200/410] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:50.373776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:50.498120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3485-1aa6-4c0b-850a-e3d9847fc130 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.534221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471111e-36ab-4dfb-bdaf-9de116d96406 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.573980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.575038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.575551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.576031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] PATH_INFO: `/v3/groups/33f96f895c0344f5ad48f6c752b040b3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.577398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] RBAC: Authorizing `identity:get_group(group_id=33f96f895c0344f5ad48f6c752b040b3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.579074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:50.581066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 201/411] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:50 2022] GET /identity/v3/groups/33f96f895c0344f5ad48f6c752b040b3 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:50.586599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:50.592518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.593169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.593450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.593725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.599981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.602071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:50.604165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 211/412] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:50 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:50.609246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:50.622047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:50.685003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:50.731857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dbea4-2bc8-4424-a889-79644f3d6fda None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.795972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.796618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.796895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.797169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] PATH_INFO: `/v3/projects/fe087670259b408d800e85991f04fa29` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.798846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] RBAC: Authorizing `identity:get_project(project_id=fe087670259b408d800e85991f04fa29)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.800313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:50.804582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160bec6-4e60-4550-bc9c-e5139b4cde82 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.806981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 202/413] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:50 2022] GET /identity/v3/projects/fe087670259b408d800e85991f04fa29 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:50.809212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:50.881339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f0296-2631-4e8d-89d9-6de35ad56f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.882028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0296-2631-4e8d-89d9-6de35ad56f27 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.882374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0296-2631-4e8d-89d9-6de35ad56f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.882650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0296-2631-4e8d-89d9-6de35ad56f27 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/e74e413191434331b30c59872ddd2015` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.889100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f0296-2631-4e8d-89d9-6de35ad56f27 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee2fa4db020d49458f66a1e5b82688be, group_id=ebcee4c9cbb9448eaa725f11babd29fc, role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.890560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f0296-2631-4e8d-89d9-6de35ad56f27 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:50.917542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 212/414] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 04:04:50 2022] PUT /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be/groups/ebcee4c9cbb9448eaa725f11babd29fc/roles/e74e413191434331b30c59872ddd2015 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:04:50.919694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:50.928742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ddf75-695b-42b5-a21e-36f84e224132 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:50.985345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb88d4-c185-4c32-b44a-89a24801ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:50.986430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb88d4-c185-4c32-b44a-89a24801ec57 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:50.986917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb88d4-c185-4c32-b44a-89a24801ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:50.987394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb88d4-c185-4c32-b44a-89a24801ec57 None admin] PATH_INFO: `/v3/projects/fe087670259b408d800e85991f04fa29/groups/33f96f895c0344f5ad48f6c752b040b3/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:50.989658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb88d4-c185-4c32-b44a-89a24801ec57 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe087670259b408d800e85991f04fa29, group_id=33f96f895c0344f5ad48f6c752b040b3, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:50.991410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb88d4-c185-4c32-b44a-89a24801ec57 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:51.023858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 203/415] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 04:04:50 2022] PUT /identity/v3/projects/fe087670259b408d800e85991f04fa29/groups/33f96f895c0344f5ad48f6c752b040b3/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:04:51.376721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c4f7-c7a5-4829-bc3b-35f9b42ecb80 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.377449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c4f7-c7a5-4829-bc3b-35f9b42ecb80 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.377938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c4f7-c7a5-4829-bc3b-35f9b42ecb80 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.379808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 213/416] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:51.386491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7390-83cf-4fe7-b763-5bcad1a06371 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.387073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7390-83cf-4fe7-b763-5bcad1a06371 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.387576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7390-83cf-4fe7-b763-5bcad1a06371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.406312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-afbd7390-83cf-4fe7-b763-5bcad1a06371 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:51.407868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-afbd7390-83cf-4fe7-b763-5bcad1a06371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:51.483364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 204/417] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:51.520355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c4f7-c7a5-4829-bc3b-35f9b42ecb80 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:51.534310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b589-aba9-4b50-b422-37c11dc031fd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.534954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b589-aba9-4b50-b422-37c11dc031fd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.535456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5b589-aba9-4b50-b422-37c11dc031fd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.538247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 205/418] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:51.545962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25672b2b-986f-4166-889b-9994614832fe None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.545962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25672b2b-986f-4166-889b-9994614832fe None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.545962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25672b2b-986f-4166-889b-9994614832fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.570938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-25672b2b-986f-4166-889b-9994614832fe None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:51.572843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-25672b2b-986f-4166-889b-9994614832fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:51.663608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 206/419] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:51.688294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:51.700722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c4f7-c7a5-4829-bc3b-35f9b42ecb80 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:51.706278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25672b2b-986f-4166-889b-9994614832fe None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:51.739550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:51.777590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:51.778237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.778512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.778780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.793969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:51.805049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:51.806210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:51.807202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 214/420] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:51.814524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:51.866303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25672b2b-986f-4166-889b-9994614832fe None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:51.905149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d5b09-0f1e-44b1-a503-a05de3163daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:51.906211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5b09-0f1e-44b1-a503-a05de3163daf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.906808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5b09-0f1e-44b1-a503-a05de3163daf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.907311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5b09-0f1e-44b1-a503-a05de3163daf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.919891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d5b09-0f1e-44b1-a503-a05de3163daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-644d5b09-0f1e-44b1-a503-a05de3163daf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:51.925697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:51.926586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:51.927448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:51.928527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030540-c8fc-4887-90c8-eb5d2651689e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:51.930813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 207/421] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:04:51.932322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5f6a-f976-4896-9a90-6621cf9aac3a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.932825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5f6a-f976-4896-9a90-6621cf9aac3a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.933312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5f6a-f976-4896-9a90-6621cf9aac3a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.938892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 208/422] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:51.939910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c5f6a-f976-4896-9a90-6621cf9aac3a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:51.963598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a86db-f7d6-4e82-b7e7-896ccd5ddae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:51.964221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a86db-f7d6-4e82-b7e7-896ccd5ddae3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.964498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a86db-f7d6-4e82-b7e7-896ccd5ddae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.964768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a86db-f7d6-4e82-b7e7-896ccd5ddae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.965475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a86db-f7d6-4e82-b7e7-896ccd5ddae3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:51.965782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a86db-f7d6-4e82-b7e7-896ccd5ddae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:51.967543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a86db-f7d6-4e82-b7e7-896ccd5ddae3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:51.976487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 215/423] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:51.977880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b45ddb-618b-4fbf-a6c5-b5d5f8414786 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:51.978160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b45ddb-618b-4fbf-a6c5-b5d5f8414786 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:51.978478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b45ddb-618b-4fbf-a6c5-b5d5f8414786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:51.997097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-63b45ddb-618b-4fbf-a6c5-b5d5f8414786 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:51.998444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-63b45ddb-618b-4fbf-a6c5-b5d5f8414786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:52.005913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.039195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.062779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c5f6a-f976-4896-9a90-6621cf9aac3a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.079282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 216/424] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:52.079282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b45ddb-618b-4fbf-a6c5-b5d5f8414786 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.127281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.127907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.128182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.128457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.129526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:52.129832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:52.131203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:52.142706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 209/425] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:52.143670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.192945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b45ddb-618b-4fbf-a6c5-b5d5f8414786 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.232440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.233055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.233336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.234267 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.246167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.269494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8ccca-aab9-4ce5-977a-7f571bfff6ad None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.306923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:52.308575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:52.310356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.311383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.311871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.312370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.324225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:52.330246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:52.331150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 04:04:52.332009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:52.339904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 210/426] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:52.341081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.344354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.412611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 217/427] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:52.413652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.455809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19ce8a-cef7-43fb-8095-d09f4fbaffe5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.457755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.498804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.499981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.500471 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.500964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.524426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e61e8-3f24-4fcd-8674-ed96758d0973 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.558931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584902dd-7214-431d-9c95-339453736708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.559583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584902dd-7214-431d-9c95-339453736708 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.559866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584902dd-7214-431d-9c95-339453736708 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.560143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584902dd-7214-431d-9c95-339453736708 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.561175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584902dd-7214-431d-9c95-339453736708 None admin] RBAC: Adding query filter params (name=member) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:52.561175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584902dd-7214-431d-9c95-339453736708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:52.562524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584902dd-7214-431d-9c95-339453736708 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:52.576284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 218/428] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:52.576284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584902dd-7214-431d-9c95-339453736708 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.584365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:52.586451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:52.588732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.674133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584902dd-7214-431d-9c95-339453736708 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.676769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.710070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.710442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 211/429] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:52.710649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.710910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.711245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.712279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.712467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:52.713914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:52.715603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 219/430] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:52.716360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.830680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bec5b1-2d1c-42e1-826e-b8b314c75dde None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.831235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d6a1-15f2-4aa0-9d04-fbd87c225643 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:52.833178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.867143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.867934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.868357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.868640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] PATH_INFO: `/v3/projects/cb483f0975a64603b7294f5ce29aa037` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.869808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] RBAC: Authorizing `identity:get_project(project_id=cb483f0975a64603b7294f5ce29aa037)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:52.871304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:52.873165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 220/431] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/projects/cb483f0975a64603b7294f5ce29aa037 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:52.873761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:52.874094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:52.874955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:52.875467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:52.875945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:52.918032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:52.955732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:52.957642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:52.978903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000aa7-99d4-475b-be78-51429c5c4b77 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.029640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.030292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.030577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.030852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.033065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:53.034592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:53.036574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 221/432] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:53.040097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.085939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 212/433] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:53.085939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.085939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:53.174598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f8e0c-f256-4367-8389-98499a857780 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.184814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:53.192040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2050e36-d2c9-4d36-887f-5ebac9708b10 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.216327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.216978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.217245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.217516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.219295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:53.220736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:53.222309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 222/434] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:53.223062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.233598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2030c1c-7577-4510-a955-1ec140298974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.234157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030c1c-7577-4510-a955-1ec140298974 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.234440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030c1c-7577-4510-a955-1ec140298974 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.234717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030c1c-7577-4510-a955-1ec140298974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.235593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2030c1c-7577-4510-a955-1ec140298974 None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=e74e413191434331b30c59872ddd2015, scope.project.id=cb483f0975a64603b7294f5ce29aa037) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:53.235910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2030c1c-7577-4510-a955-1ec140298974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:53.237361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2030c1c-7577-4510-a955-1ec140298974 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:53.248266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 213/435] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=e74e413191434331b30c59872ddd2015 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:53.248266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5a86b-228d-4052-a6a7-4af5d15ba411 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.248266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5a86b-228d-4052-a6a7-4af5d15ba411 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.248266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5a86b-228d-4052-a6a7-4af5d15ba411 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.248266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 214/436] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:53.248266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5a86b-228d-4052-a6a7-4af5d15ba411 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.334603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:53.361759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e7ce-3afa-4268-909c-b41631663149 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.379136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5a86b-228d-4052-a6a7-4af5d15ba411 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.400671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdd278-b0f1-4ba0-97a1-f9e1c3b1a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.401505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdd278-b0f1-4ba0-97a1-f9e1c3b1a153 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.401889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdd278-b0f1-4ba0-97a1-f9e1c3b1a153 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.402270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdd278-b0f1-4ba0-97a1-f9e1c3b1a153 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.403630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdd278-b0f1-4ba0-97a1-f9e1c3b1a153 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:53.405457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdd278-b0f1-4ba0-97a1-f9e1c3b1a153 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:53.407606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 223/437] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:53.412311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc8f0-aa22-4052-8cc5-7767a6b0a255 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.412704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc8f0-aa22-4052-8cc5-7767a6b0a255 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.413089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc8f0-aa22-4052-8cc5-7767a6b0a255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.419453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.420079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.420356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.420734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.421580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=cb483f0975a64603b7294f5ce29aa037) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:53.421987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:53.423460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:53.432088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 215/438] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=cb483f0975a64603b7294f5ce29aa037&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:53.432261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.435736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b7bbc8f0-aa22-4052-8cc5-7767a6b0a255 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:53.437227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b7bbc8f0-aa22-4052-8cc5-7767a6b0a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:53.487370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:53.525586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 224/439] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:53.527377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994274-4179-4c6c-8856-14a2b16ea503 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.527890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994274-4179-4c6c-8856-14a2b16ea503 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.528388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994274-4179-4c6c-8856-14a2b16ea503 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.529934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 225/440] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:53.536822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd5509-ac40-4fac-901b-f18bd2324cf4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.537114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd5509-ac40-4fac-901b-f18bd2324cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.537378 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd5509-ac40-4fac-901b-f18bd2324cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.558325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-99bd5509-ac40-4fac-901b-f18bd2324cf4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:53.560043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-99bd5509-ac40-4fac-901b-f18bd2324cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:53.581369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72796d6-d2c9-4ebc-98f5-50665a9a5747 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.620411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:53.627751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.628462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.628744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.629041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.630202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:53.631715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:53.634192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 216/441] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:53.634970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.643496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 226/442] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:53.644354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd5509-ac40-4fac-901b-f18bd2324cf4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.766976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d2b3-1db7-4d72-9c4d-1eafaa7381a9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.776505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd5509-ac40-4fac-901b-f18bd2324cf4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.780304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:53.809368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.810021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.810306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.810590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.816444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:53.817222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:53.817558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:53.817779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:53.818575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=754e311d9d2c401189da910d6d3bfe01, scope.project.id=ee2fa4db020d49458f66a1e5b82688be) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:53.818968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:53.822288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:53.826378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:53.827906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 227/443] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=754e311d9d2c401189da910d6d3bfe01 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:53.828720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:53.832189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:53.833427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:53.834240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 217/444] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:53.840507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:53.925937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:53.972199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b70e4-6472-4c66-a6c5-c0cb7c7035fa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:53.988442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b5f86-bebe-4629-8f0c-4d4b9dbc3744 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.024210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.024866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.025153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.025428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.033342 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.033960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.034905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.034905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.035206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:54.035770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.036993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.038037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:54.044350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:54.045271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:54.046104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 228/445] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:54.051126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 218/446] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:54.051618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.052841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.084261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.169773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4328ffa-56c3-44c3-b91a-b11efd4234d5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.170366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886a1d-c105-4f57-a784-79087fd786c2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.193718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.215761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.216603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.217049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.217197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.217509 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.217813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.218097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.218374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.219089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:54.219467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.220842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.229712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 229/447] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:54.235318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.287914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.290341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.325723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.336164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf046c-7b71-4345-80b3-39d34c643567 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.369437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.370048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.370336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.370607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.394048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 219/448] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:04:54.400499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.421376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.442331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.443842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.500533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe0eb-1e78-4a30-a553-6792e546716a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.533253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.534055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.534701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.534981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.535277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] PATH_INFO: `/v3/projects/ee2fa4db020d49458f66a1e5b82688be` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.536453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2fa4db020d49458f66a1e5b82688be)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.537902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.540250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 220/449] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/projects/ee2fa4db020d49458f66a1e5b82688be => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:54.544493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 230/450] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 04:04:54.545789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.549780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.633326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.644672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e014e-4e2e-408d-b0e1-3956fcba4a58 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.645975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cdf61-80d7-40f5-a560-6231595e3502 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.678849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.679861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.680010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.680288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.680558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.680648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] PATH_INFO: `/v3/projects/fe087670259b408d800e85991f04fa29` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.680843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.681122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] PATH_INFO: `/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.681705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] RBAC: Authorizing `identity:get_project(project_id=fe087670259b408d800e85991f04fa29)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.682272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] RBAC: Authorizing `identity:get_group(group_id=ebcee4c9cbb9448eaa725f11babd29fc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.683143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.683737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.684843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 231/451] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/projects/fe087670259b408d800e85991f04fa29 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:54.689401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 221/452] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/groups/ebcee4c9cbb9448eaa725f11babd29fc => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:54.690188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.690934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.754558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.792352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278f70-9b5a-4502-a3d0-99931ea4963b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.795839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d597-30e3-49e3-9479-8aaa633ce602 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.827046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106355f-f611-4ebe-a65b-b40d5c3d2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.827699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106355f-f611-4ebe-a65b-b40d5c3d2d05 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.827977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106355f-f611-4ebe-a65b-b40d5c3d2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.828252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106355f-f611-4ebe-a65b-b40d5c3d2d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.829037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106355f-f611-4ebe-a65b-b40d5c3d2d05 None admin] RBAC: Adding query filter params (group.id=ebcee4c9cbb9448eaa725f11babd29fc, role.id=e74e413191434331b30c59872ddd2015, scope.project.id=ee2fa4db020d49458f66a1e5b82688be) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:54.829347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106355f-f611-4ebe-a65b-b40d5c3d2d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.829497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.830157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.830440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.830711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] PATH_INFO: `/v3/groups/33f96f895c0344f5ad48f6c752b040b3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.830798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106355f-f611-4ebe-a65b-b40d5c3d2d05 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.831865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] RBAC: Authorizing `identity:get_group(group_id=33f96f895c0344f5ad48f6c752b040b3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.833286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.834846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 232/453] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/groups/33f96f895c0344f5ad48f6c752b040b3 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:54.836819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 222/454] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/role_assignments?group.id=ebcee4c9cbb9448eaa725f11babd29fc&scope.project.id=ee2fa4db020d49458f66a1e5b82688be&role.id=e74e413191434331b30c59872ddd2015 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:04:54.840917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:54.946304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d432b-a68b-48cd-99db-78562417b70d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:54.973487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:54.982111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4194e-67f9-4cd8-a8fd-a84a256a211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:54.982736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4194e-67f9-4cd8-a8fd-a84a256a211d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:54.983012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4194e-67f9-4cd8-a8fd-a84a256a211d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:54.983306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4194e-67f9-4cd8-a8fd-a84a256a211d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:54.984099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4194e-67f9-4cd8-a8fd-a84a256a211d None admin] RBAC: Adding query filter params (group.id=33f96f895c0344f5ad48f6c752b040b3, role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=fe087670259b408d800e85991f04fa29) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:54.984409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4194e-67f9-4cd8-a8fd-a84a256a211d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:54.985841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4194e-67f9-4cd8-a8fd-a84a256a211d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:54.991911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 233/455] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 04:04:54 2022] GET /identity/v3/role_assignments?group.id=33f96f895c0344f5ad48f6c752b040b3&scope.project.id=fe087670259b408d800e85991f04fa29&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:57.766413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45055438-2649-474f-ab2f-19b8d3cd091b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:57.766906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45055438-2649-474f-ab2f-19b8d3cd091b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:57.766979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45055438-2649-474f-ab2f-19b8d3cd091b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:57.768676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 223/456] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:57.769491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14d91-d65b-4fda-aba7-164c9649f118 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:57.769892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14d91-d65b-4fda-aba7-164c9649f118 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:57.771311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14d91-d65b-4fda-aba7-164c9649f118 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:57.771850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 234/457] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:57.777256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d00c7-b27f-4be0-81a8-76638dbb8648 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:57.777546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d00c7-b27f-4be0-81a8-76638dbb8648 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:57.777824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d00c7-b27f-4be0-81a8-76638dbb8648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:57.778474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e4504-b547-4903-b788-d45171db821f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:57.778962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e4504-b547-4903-b788-d45171db821f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:57.779478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e4504-b547-4903-b788-d45171db821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:57.798801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f79e4504-b547-4903-b788-d45171db821f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:57.800335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f79e4504-b547-4903-b788-d45171db821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:57.811347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-388d00c7-b27f-4be0-81a8-76638dbb8648 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:57.812437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-388d00c7-b27f-4be0-81a8-76638dbb8648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:57.845345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:57.901853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 235/458] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:57.926688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0f467-3dc1-4f77-976f-0741ab2d01e2 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:57.927237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0f467-3dc1-4f77-976f-0741ab2d01e2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:57.927687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0f467-3dc1-4f77-976f-0741ab2d01e2 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:57.933363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 236/459] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:04:57.935023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146e08-386d-49a7-86fa-464be48f1277 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:57.935485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146e08-386d-49a7-86fa-464be48f1277 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:57.936052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146e08-386d-49a7-86fa-464be48f1277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:57.944272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 224/460] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:57.945732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d00c7-b27f-4be0-81a8-76638dbb8648 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:57.955981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-53146e08-386d-49a7-86fa-464be48f1277 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:57.957381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-53146e08-386d-49a7-86fa-464be48f1277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:58.055285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 237/461] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:04:58.055285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146e08-386d-49a7-86fa-464be48f1277 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.103143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d00c7-b27f-4be0-81a8-76638dbb8648 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.103839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:58.148245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.149010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.149177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.149434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.160117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.161636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.165883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146e08-386d-49a7-86fa-464be48f1277 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:04:58.177698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:58.178616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:58.180314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:04:58.180314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:04:58.180314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.180314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:58.183787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 225/462] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:58.184651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.187410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:58.205694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.206555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.207004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.207448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.219683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.221385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:04:58.239304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:58.240423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:58.242046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:04:58.242046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:04:58.242046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.242046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:58.243731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 238/463] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:58.244859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.299184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54b4fc-1845-4c61-8965-f374cae9133f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.334057 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd414d-d038-4fcf-8bb4-46363d61b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.334741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd414d-d038-4fcf-8bb4-46363d61b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.335019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd414d-d038-4fcf-8bb4-46363d61b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.335845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd414d-d038-4fcf-8bb4-46363d61b1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.346699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd414d-d038-4fcf-8bb4-46363d61b1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.348189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd414d-d038-4fcf-8bb4-46363d61b1a8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-19cd414d-d038-4fcf-8bb4-46363d61b1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:04:58.363507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:58.364395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:58.365267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:04:58.365267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:04:58.365267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.365267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:58.365267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 226/464] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:58.365890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7539c-ced8-404a-b95a-088d47cf4d17 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.366109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7539c-ced8-404a-b95a-088d47cf4d17 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.366459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7539c-ced8-404a-b95a-088d47cf4d17 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.368108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 227/465] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:58.368510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0587783-c080-42f5-84ba-cfcee1e693ed None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.368846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7539c-ced8-404a-b95a-088d47cf4d17 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.370722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:58.411521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba41c-9300-42d8-b55d-c13fe8a3932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.412136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba41c-9300-42d8-b55d-c13fe8a3932e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.412411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba41c-9300-42d8-b55d-c13fe8a3932e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.412681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba41c-9300-42d8-b55d-c13fe8a3932e None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.414637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba41c-9300-42d8-b55d-c13fe8a3932e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:58.415027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba41c-9300-42d8-b55d-c13fe8a3932e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.416562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba41c-9300-42d8-b55d-c13fe8a3932e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.429852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 239/466] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:58.431847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fcde-252e-404e-b087-209ae2afcf4d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.432726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fcde-252e-404e-b087-209ae2afcf4d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.433356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fcde-252e-404e-b087-209ae2afcf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.434928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:58.452324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-76b5fcde-252e-404e-b087-209ae2afcf4d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:58.453950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-76b5fcde-252e-404e-b087-209ae2afcf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:58.483746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7539c-ced8-404a-b95a-088d47cf4d17 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.520764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.521382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.521668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.521948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.523133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:58.523688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.524959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.535288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 240/467] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:58.535288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fcde-252e-404e-b087-209ae2afcf4d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.546786 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 228/468] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:58.547745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.629787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:58.640084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fcde-252e-404e-b087-209ae2afcf4d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.672653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97af7-e83a-4779-ae29-e32b2c38a313 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.676181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.676814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.677101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.677378 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.678081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:58.678388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.680491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.692134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:58.693157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 241/469] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:58.693959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.719946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.721033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.721536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.721882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.722638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.724190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.767314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 229/470] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:58 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:58.767314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.833899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebb976-663f-4f52-833b-b4211a26291c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.875341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.876139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.876429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.877038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.877803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.879371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.892955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde00ae8-98bf-4837-84ac-ac802d894dac None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:58.915298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 242/471] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:58 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:58.915298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:58.930880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:58.959085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d789c3b-7241-48ad-afc2-7a62bec90fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:58.959810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789c3b-7241-48ad-afc2-7a62bec90fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.960223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789c3b-7241-48ad-afc2-7a62bec90fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.960414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789c3b-7241-48ad-afc2-7a62bec90fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.972327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d789c3b-7241-48ad-afc2-7a62bec90fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:58.973819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d789c3b-7241-48ad-afc2-7a62bec90fc3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6d789c3b-7241-48ad-afc2-7a62bec90fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:04:58.993164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:58.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:58.994967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:04:58.994967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:04:58.994967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:04:58.994967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:58.994967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 230/472] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:58.995878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81086-6c4e-4fc2-91f7-8e460b9be365 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:58.996174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81086-6c4e-4fc2-91f7-8e460b9be365 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:58.996453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81086-6c4e-4fc2-91f7-8e460b9be365 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:58.997990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 231/473] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:04:59.003685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81086-6c4e-4fc2-91f7-8e460b9be365 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:59.040957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:59.076893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a541d-a6fd-4fc9-a664-267bad086ca2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:59.127067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090eb96-f796-4d8b-ae04-c21290ba891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:59.128096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090eb96-f796-4d8b-ae04-c21290ba891e None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:59.128582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090eb96-f796-4d8b-ae04-c21290ba891e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:59.129046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090eb96-f796-4d8b-ae04-c21290ba891e None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:59.129987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090eb96-f796-4d8b-ae04-c21290ba891e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:59.131196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090eb96-f796-4d8b-ae04-c21290ba891e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:59.141731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81086-6c4e-4fc2-91f7-8e460b9be365 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:59.159564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 243/474] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:58 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:04:59.160851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51619a-b3d1-4977-bdd6-4afa1f4ba925 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:59.161141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51619a-b3d1-4977-bdd6-4afa1f4ba925 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:59.161424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51619a-b3d1-4977-bdd6-4afa1f4ba925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:59.182695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7a51619a-b3d1-4977-bdd6-4afa1f4ba925 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:04:59.183026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:59.183983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7a51619a-b3d1-4977-bdd6-4afa1f4ba925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:04:59.184742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:59.185030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:59.185310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:59.186040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:59.186358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:59.187826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:59.202562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 232/475] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:04:59.207814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:59.261440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:59.270745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 244/476] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:04:59.331717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:59.337591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51619a-b3d1-4977-bdd6-4afa1f4ba925 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:59.346326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5600a3-1358-404e-af49-131e06032b7c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:59.385459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:59.386461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:59.386970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:59.387671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:59.388598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:59.390568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:59.427285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 233/477] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:04:59 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:04:59.496978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51619a-b3d1-4977-bdd6-4afa1f4ba925 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:59.536977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:59.538056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:59.539154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:59.539653 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:59.541588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:59.543360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:59.553583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.sql.core [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 04:04:59.553583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 04:04:59.553583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [parameters: {'id': 'dbad881f674c4002ab7f69a15d558160', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 04:04:59.553583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() Jul 27 04:04:59.572894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 04:04:59.573880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application yield resource Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise self.value Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application session.commit() Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 04:04:59.574843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.flush() Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application compat.raise_( Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 04:04:59.575780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 04:04:59.576894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 04:04:59.577919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [parameters: {'id': 'dbad881f674c4002ab7f69a15d558160', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:59.578914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 04:04:59.579836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:04:59.582635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 245/478] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 04:04:59 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:59.588367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:59.713904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f64c-09b6-4ad1-8bf7-f812c25e72d9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:59.758054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48663e-7cb8-48b6-9386-43010511cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:59.759106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48663e-7cb8-48b6-9386-43010511cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:59.759558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48663e-7cb8-48b6-9386-43010511cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:59.760279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48663e-7cb8-48b6-9386-43010511cdb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:59.767666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:59.774398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48663e-7cb8-48b6-9386-43010511cdb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1b48663e-7cb8-48b6-9386-43010511cdb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:04:59.780128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:04:59.781220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 04:04:59.782224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:04:59.784799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 234/479] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:04:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:04:59.796345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:04:59.867697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:04:59.914424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611af420-6cfb-4b4c-9982-839a4cf42935 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:04:59.950023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c908c-cf40-48c2-8a39-e71a02644389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:04:59.950700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c908c-cf40-48c2-8a39-e71a02644389 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:04:59.951033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c908c-cf40-48c2-8a39-e71a02644389 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:04:59.951341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c908c-cf40-48c2-8a39-e71a02644389 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:04:59.952065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c908c-cf40-48c2-8a39-e71a02644389 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:04:59.952374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c908c-cf40-48c2-8a39-e71a02644389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:04:59.953751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c908c-cf40-48c2-8a39-e71a02644389 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:04:59.962394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 246/480] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:04:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:01.232305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127565d-5d4d-4f84-91c6-2e8123faa04c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:01.233343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127565d-5d4d-4f84-91c6-2e8123faa04c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:01.233343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127565d-5d4d-4f84-91c6-2e8123faa04c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:01.234977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 235/481] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:01.240210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371ede-6053-4c63-9d42-3776b6fac890 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:01.240626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371ede-6053-4c63-9d42-3776b6fac890 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:01.240817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371ede-6053-4c63-9d42-3776b6fac890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:01.263690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8c371ede-6053-4c63-9d42-3776b6fac890 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:01.264893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8c371ede-6053-4c63-9d42-3776b6fac890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:01.288158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78570d65-7fa0-4fe8-9fbc-d23d196a23b3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:01.289001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78570d65-7fa0-4fe8-9fbc-d23d196a23b3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:01.289267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78570d65-7fa0-4fe8-9fbc-d23d196a23b3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:01.290593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 236/482] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:01.308553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f23a-4751-4021-bdb4-75b70b7d2245 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:01.308836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f23a-4751-4021-bdb4-75b70b7d2245 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:01.309111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f23a-4751-4021-bdb4-75b70b7d2245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:01.348278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b5a1f23a-4751-4021-bdb4-75b70b7d2245 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:01.349477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b5a1f23a-4751-4021-bdb4-75b70b7d2245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:01.350725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 247/483] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:01.393313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371ede-6053-4c63-9d42-3776b6fac890 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:01.465964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 237/484] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:01.475668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:01.516714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f23a-4751-4021-bdb4-75b70b7d2245 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:01.536521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371ede-6053-4c63-9d42-3776b6fac890 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:01.595017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:01.595992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:01.596458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:01.596940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:01.619589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:01.624776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:01.625674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:01.626483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:01.636161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 248/485] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:01.640140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:01.714146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f23a-4751-4021-bdb4-75b70b7d2245 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:01.768178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:01.786804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:01.787482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:01.787769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:01.788051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:01.812758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:01.817732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:01.818655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:01.820053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 238/486] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:01.834904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:01.853955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98f118-5ec1-4c9a-92f2-39c290f55d8a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:01.875613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:01.906702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:01.907446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:01.907730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:01.908125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:01.908846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:01.909154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:01.910545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:01.919417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 249/487] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:01.931499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.011107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a3665-f75e-4ecd-9f0e-1a457edeccb7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.050750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2e46-7d43-47f8-977f-4f97304cbfe2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.059941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e39ee-05bb-4016-9f7a-245f2a1ee17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.061044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e39ee-05bb-4016-9f7a-245f2a1ee17b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.061323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e39ee-05bb-4016-9f7a-245f2a1ee17b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.061594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e39ee-05bb-4016-9f7a-245f2a1ee17b None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.062720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e39ee-05bb-4016-9f7a-245f2a1ee17b None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:02.063320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e39ee-05bb-4016-9f7a-245f2a1ee17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.064944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e39ee-05bb-4016-9f7a-245f2a1ee17b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.078414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 239/488] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:02.079887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e854f-cef1-4b0b-beff-57d1d2cb021b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.080171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e854f-cef1-4b0b-beff-57d1d2cb021b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.080446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e854f-cef1-4b0b-beff-57d1d2cb021b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.081912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 240/489] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:02.083105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e854f-cef1-4b0b-beff-57d1d2cb021b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.095605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b76eaa-6a11-4eb3-95ff-8de8b2886795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.096356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b76eaa-6a11-4eb3-95ff-8de8b2886795 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.096712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b76eaa-6a11-4eb3-95ff-8de8b2886795 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.097063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b76eaa-6a11-4eb3-95ff-8de8b2886795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.109827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b76eaa-6a11-4eb3-95ff-8de8b2886795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.111547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b76eaa-6a11-4eb3-95ff-8de8b2886795 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-72b76eaa-6a11-4eb3-95ff-8de8b2886795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:02.128221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:02.129116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:02.129987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:02.129987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:02.129987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:02.129987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:02.129987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 250/490] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:02.130677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d007-7c77-4ce4-9fa4-d174b7b84090 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.130964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d007-7c77-4ce4-9fa4-d174b7b84090 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.131244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d007-7c77-4ce4-9fa4-d174b7b84090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.151050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:02.156299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0775d007-7c77-4ce4-9fa4-d174b7b84090 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:02.157627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0775d007-7c77-4ce4-9fa4-d174b7b84090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:02.177026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:02.206740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e854f-cef1-4b0b-beff-57d1d2cb021b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.233944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 251/491] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:02.235005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d007-7c77-4ce4-9fa4-d174b7b84090 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.250140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc8d76-8ff5-4a40-909a-ada08ad2703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.251962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8d76-8ff5-4a40-909a-ada08ad2703f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.252522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8d76-8ff5-4a40-909a-ada08ad2703f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.252943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8d76-8ff5-4a40-909a-ada08ad2703f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.269606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc8d76-8ff5-4a40-909a-ada08ad2703f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.271574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc8d76-8ff5-4a40-909a-ada08ad2703f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-41bc8d76-8ff5-4a40-909a-ada08ad2703f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:02.288815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:02.289700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:02.291145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:02.291145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:02.291145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:02.291145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:02.291145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 241/492] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:02.291572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268941-201a-4ca1-a6f5-32d475dfa702 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.291860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268941-201a-4ca1-a6f5-32d475dfa702 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.292137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268941-201a-4ca1-a6f5-32d475dfa702 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.293532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 242/493] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:02.296657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6268941-201a-4ca1-a6f5-32d475dfa702 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.347627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d007-7c77-4ce4-9fa4-d174b7b84090 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.386720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.387756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.388234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.388582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.389280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:02.389609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.391205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.403112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 252/494] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:02.408438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.410819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6268941-201a-4ca1-a6f5-32d475dfa702 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.412529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:02.427027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:02.450503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfdd0b-7061-4612-9b2e-4f1151340745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.451203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfdd0b-7061-4612-9b2e-4f1151340745 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.451517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfdd0b-7061-4612-9b2e-4f1151340745 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.451792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfdd0b-7061-4612-9b2e-4f1151340745 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.463684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfdd0b-7061-4612-9b2e-4f1151340745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-08cfdd0b-7061-4612-9b2e-4f1151340745 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:02.469272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:02.470177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:02.471010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 243/495] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:02.472214 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85ed6-9cc9-40f7-a30b-10c4fd959f79 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.472214 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85ed6-9cc9-40f7-a30b-10c4fd959f79 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.472400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85ed6-9cc9-40f7-a30b-10c4fd959f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.491068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1ed85ed6-9cc9-40f7-a30b-10c4fd959f79 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:02.493304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1ed85ed6-9cc9-40f7-a30b-10c4fd959f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:02.520166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203f822-2137-4251-b6c1-44c201d1f3ee None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.555740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.556806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.557272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.557558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.558245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:02.558553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.559961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.567323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 244/496] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:02.567323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85ed6-9cc9-40f7-a30b-10c4fd959f79 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.583408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 253/497] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:02.584556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.664118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:02.665181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:02.674896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85ed6-9cc9-40f7-a30b-10c4fd959f79 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.693540 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58a9fc-93c0-4c3c-8da0-e1ed18007da7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.710857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.711530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.711810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.712083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.719083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.720563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.728926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.729577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.729858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.730137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.730849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:02.731155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.732574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:02.736065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:02.737005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:02.737967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 245/498] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:02.738540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.745923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 254/499] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:02.746773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.840552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa300f09-1a62-4a25-9844-e6de119968a7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.847794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8d40d-d010-47b8-9781-dad9a82aa069 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:02.874436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f11f5-ebcf-4bec-ad45-4b4e03928436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.875068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f11f5-ebcf-4bec-ad45-4b4e03928436 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.875381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f11f5-ebcf-4bec-ad45-4b4e03928436 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.875667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f11f5-ebcf-4bec-ad45-4b4e03928436 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.881670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:02.882328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.882612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.882885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.883068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f11f5-ebcf-4bec-ad45-4b4e03928436 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:02.884565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f11f5-ebcf-4bec-ad45-4b4e03928436 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:02.885901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:02.894044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b31f11f5-ebcf-4bec-ad45-4b4e03928436 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:02.896545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:02.898135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:02.899160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 246/500] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:02.900006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43f84-2b71-4ddc-bd6b-67e1c32b6203 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:02.900006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43f84-2b71-4ddc-bd6b-67e1c32b6203 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:02.900006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43f84-2b71-4ddc-bd6b-67e1c32b6203 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:02.900189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:02.901029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:02.901899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 255/501] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:02.903250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.906166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 247/502] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:02.906898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e43f84-2b71-4ddc-bd6b-67e1c32b6203 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:02.922044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.002054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82de90-3ac0-4978-869c-3bf7c7637bd0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.006506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e43f84-2b71-4ddc-bd6b-67e1c32b6203 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.035008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.035648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.035922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.036189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.036968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:03.037267 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.038804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.039538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.040167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.040448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.040723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.052584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.054082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:03.068114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:03.068987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:03.070621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:03.070621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:03.070621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:03.070621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:03.070621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 248/503] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:03.070621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.078058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 256/504] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:05:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:03.079056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.131224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.133595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.171044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8766-ce28-460f-988a-087f9feff59c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.177524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d311527-1e80-497c-b27a-7566aee98671 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.205365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.205966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.206245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.206513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.207314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:03.207616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.209020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.211175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac185b9-e53d-4e4e-a693-bbff9e80c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.211814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac185b9-e53d-4e4e-a693-bbff9e80c20d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.212095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac185b9-e53d-4e4e-a693-bbff9e80c20d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.212373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac185b9-e53d-4e4e-a693-bbff9e80c20d None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.213076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac185b9-e53d-4e4e-a693-bbff9e80c20d None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:03.213383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac185b9-e53d-4e4e-a693-bbff9e80c20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.214762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac185b9-e53d-4e4e-a693-bbff9e80c20d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.222572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 257/505] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:03.223752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99599b7-38d9-413d-af7b-40ea96c2ac50 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.224037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99599b7-38d9-413d-af7b-40ea96c2ac50 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.224311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99599b7-38d9-413d-af7b-40ea96c2ac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.241135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e99599b7-38d9-413d-af7b-40ea96c2ac50 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:03.242447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e99599b7-38d9-413d-af7b-40ea96c2ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:03.246210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 249/506] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:03.247042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.309362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 258/507] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:03.310567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99599b7-38d9-413d-af7b-40ea96c2ac50 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.356512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.362913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bbb9f-63c4-4800-95f0-379ed551f87b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.385893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.398583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.399247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.399554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.399819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.400513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:03.400821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.402204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.408897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99599b7-38d9-413d-af7b-40ea96c2ac50 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.414340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 250/508] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:03.415045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.445669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.446216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.446499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.446779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.512608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.514080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f1bd9-0418-4d39-aa60-9cd3596e3e6e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.514183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.547381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.548015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.548316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.548576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.558853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.559515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.561225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:03.578184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:03.579061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:03.579982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:03.579982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:03.579982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:03.579982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:03.579982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 251/509] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:03.580249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.612896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.620528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 259/510] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:03.621362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.683290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a139-4db9-4152-8aa8-c79c748b1945 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.717506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.718051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.718206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00658-44b7-4905-bfb3-58b78b816d42 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.718333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.718610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.754572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.755211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.755524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.755801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.766572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.768064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.774735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:03.783939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:03.784811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:03.785685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:03.785685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:03.785685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:03.785685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:03.785685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 260/511] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:03.785956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.791124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.792832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.828381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:03.888703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237e4b-9681-40c9-a03b-f5d87268b6b0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:03.895079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 252/512] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:03.895944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.923766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:03.924400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:03.924675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:03.924948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:03.932375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:03.933836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:03.946681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:03.947910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 261/513] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:03.949013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:03.996012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bb6af-a4e4-4c85-80eb-637a16037f04 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.006320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.031038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.031681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.031962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.032234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.032921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:04.033225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.034581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.036116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.046886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 253/514] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:04.047726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.054524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347343d-c545-4264-92d9-3463949ad1ac None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.088217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.088855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.089136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.089414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.100475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.102496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:04.116852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:04.117722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:04.118596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:04.118596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:04.118596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:04.118596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:04.118596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 262/515] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:04.119317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.146821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c904591-5f6e-4340-a64c-2852658885cf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.181543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.182162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.182442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.182717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.183460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:04.183766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.185144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.196580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 254/516] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:04.197381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.219826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bfbd6-fd42-4ce8-99ef-1281f0e7d240 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.230135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.252262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.255988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.256658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.257548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.257786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.268459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.269913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:04.284041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:04.284912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:04.285807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:04.285807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:04.285807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:04.285807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:04.285807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 263/517] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:04.286087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.298765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7d68-5e66-448a-8065-e77b18aef014 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.332387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.333036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.333317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.333598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.334389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:04.334696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.336417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.353609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 255/518] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:04.354234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.387949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf373de-219d-4d32-8fe7-7debbeaeb69b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.420339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.420971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.421257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.421526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.429663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.431287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:04.443274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:04.444179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:04.445741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 264/519] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:04.446299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.458290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8eeee-d43f-446e-8d2b-cb0ca1e826ed None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.472607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.473026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.494652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.495285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.495574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.495843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.496523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:04.496822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.498179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.510376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 256/520] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:04.511093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.554844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f853-ed00-4616-8476-0312019203f3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.587390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.588000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.588288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.588563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.589232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.590675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.611153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aa9a-48d6-4eb2-a62f-d17841ef4cfc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.612415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 265/521] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:05:04 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:04.613220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.671152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.671972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.672350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.672753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.674138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:04.674835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.677075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.692281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 257/522] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:04.693439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.708265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.732020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.742272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd714b9f-685c-47fd-b8fe-1aa4428f0d04 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.783968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.784600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.784879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.785220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.811317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d653d3-56eb-432b-8873-a9aaa864f3fa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:04.849042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:04.849770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:04.850048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:04.851037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:04.851770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:04.852078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.853609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.863408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:04.864873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:04.873821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 258/523] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:04.878740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.952422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.974838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:04.983556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 266/524] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:04.983556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:04.990066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772fc0c-9cc8-4be2-b82c-f6a9e5afe3fe None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.028198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.028922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.029550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.029897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.037116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.039045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:05.050833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:05.052055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:05.053235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:05.056705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 259/525] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:05.057573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.090951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523a6f-791d-42e5-b095-105589af9105 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.129042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.130365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.130365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.130365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.137499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.138953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:05.151842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:05.152704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:05.153631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 267/526] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:05.154095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.167608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdcd0f-6aa3-471a-8bea-10ecf76b6e2e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.198237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:05.205761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.206752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.207034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.207479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.227752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:05.269746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a4207-47e0-4af9-a0e0-08e29d5407b9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.280740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.282292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.309341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.309908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.310187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.310463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.323170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.324730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:05.340554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:05.341515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:05.342465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:05.342465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:05.342465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:05.342465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:05.342465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 268/527] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:05.342465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.391859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 260/528] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:05.392821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.446446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:05.448694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:05.459874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaee09-961f-4014-ba26-0f60cf9dcdbd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.494697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.495514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.496050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.496050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.496799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:05.497105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.498566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.502042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f1939-6f0a-4626-9eec-6abd3c850da0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.523101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 269/529] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:05.523101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.550884 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.551535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.551821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.552104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.552856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:05.553171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.554897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.573770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 261/530] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:05.574530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.634164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc59e62-8794-425c-a42c-8492614b3c10 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.671103 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.671768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.672045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.672315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.672997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:05.673298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.674666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.686779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 270/531] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:05.687594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.688256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5faf0-7e91-4a65-b2eb-d96b8ab1fa1e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.700163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:05.704473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:05.731249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.731249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.731629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.731840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.745537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.747043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:05.763640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:05.764575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:05.765447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:05.765447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:05.765447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:05.765447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:05.765447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 262/532] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:05.765722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.811868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec1e9-3af8-4ae6-8093-434be1f14342 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.848397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.848927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.849199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.849466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.850243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a61ebb13ad8c483fa715e5f6906b05f0) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:05.850594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.852544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.858224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 271/533] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/role_assignments?user.id=a61ebb13ad8c483fa715e5f6906b05f0&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:05.858983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.878209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9718-6975-4efb-8413-2e95cc1d655f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:05.918222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:05.919161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:05.919675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:05.920142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:05.921134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=046b235e211744b0bfe631e0acf4d6e4) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:05.921628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:05.923428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:05.931232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 263/534] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/role_assignments?user.id=046b235e211744b0bfe631e0acf4d6e4&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:05.932429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:05.969528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:05.970809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:06.012569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85afa-6f68-4090-b127-ba7ce2b56941 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:06.068266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f729e1-bd2f-479d-a77c-65a6fa6cea8e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:06.071510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:06.072193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.072473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.072746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.088509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:06.091993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:06.108350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:06.109231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:06.110097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 272/535] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:06.117873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:06.149092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:06.149736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.150019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.150293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.151008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:06.151522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:06.153083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:06.176703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 264/536] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:06.186153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:06.244467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef1c5f-d32c-49b4-afb6-4796f3976bfe None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:06.280218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:06.281025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.281401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.281777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.282624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:06.283031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:06.284608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:06.287583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:06.297729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 273/537] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:06.303541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:06.356445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:06.381423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25203c3a-9780-4f93-8b2a-2277a6bb0c1e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:06.412719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c143a5d-619c-48f5-856e-e82c0d55efc8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:06.451556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:06.452320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.452545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.452820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.459314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=c2d3a3a7c1f545e593e7956ec79f25ea) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:06.459314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:06.459314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:06.462132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 274/538] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:06 2022] GET /identity/v3/role_assignments?user.id=c2d3a3a7c1f545e593e7956ec79f25ea&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:06.475945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:06.476594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.476878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.477212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.484557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:06.486036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:06.499309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:06.500278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:06.501149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 265/539] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:06.509196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:06.579469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:06.646979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745888d-168c-404d-a0ee-ea1b9831cccd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:06.693581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7e1ee-3bd0-4c4b-bab2-6807c1b20e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:06.694231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e1ee-3bd0-4c4b-bab2-6807c1b20e6e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.694544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e1ee-3bd0-4c4b-bab2-6807c1b20e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.694820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e1ee-3bd0-4c4b-bab2-6807c1b20e6e None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.695621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7e1ee-3bd0-4c4b-bab2-6807c1b20e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:06.695932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7e1ee-3bd0-4c4b-bab2-6807c1b20e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:06.700568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7e1ee-3bd0-4c4b-bab2-6807c1b20e6e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:06.714346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 275/540] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:06.720185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:06.826637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40edc01-3806-46b6-a00d-8a171b9b72d2 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.827004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40edc01-3806-46b6-a00d-8a171b9b72d2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.827185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40edc01-3806-46b6-a00d-8a171b9b72d2 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.828707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 276/541] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:06.833025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6afc9-fec6-4d14-a85f-2c2d0853c6f4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:06.836530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724241-644e-47bc-b1a2-d58f6cf86555 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.837064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724241-644e-47bc-b1a2-d58f6cf86555 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.837555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724241-644e-47bc-b1a2-d58f6cf86555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.858123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-78724241-644e-47bc-b1a2-d58f6cf86555 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:06.859681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-78724241-644e-47bc-b1a2-d58f6cf86555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:06.904953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:06.905505 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:06.905787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:06.906065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:06.906862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=e90c842029d845bd8b4f12696354af78) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:06.907173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:06.908641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:06.933281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 266/542] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:06 2022] GET /identity/v3/role_assignments?user.id=e90c842029d845bd8b4f12696354af78&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:06.943746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 277/543] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:05:06.999901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:07.020058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:07.129347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87760-5c4c-461f-ab69-7a94954a3adb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:07.176624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:07.177602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:07.178112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:07.179126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:07.191015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:07.197458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:07.198352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:07.199155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:07.201807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 267/544] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:07.207779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724241-644e-47bc-b1a2-d58f6cf86555 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:07.277809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:07.347705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724241-644e-47bc-b1a2-d58f6cf86555 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:07.382355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:07.383353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:07.383860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:07.384338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:07.385544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:07.386063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:07.387678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:07.396991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 278/545] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:07.403313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:07.481659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:07.514174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562851-d92c-46b4-88b5-c38d6b749364 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:07.550245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:07.551291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:07.551802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:07.552278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:07.564788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:07.566520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:07.582838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:07.583785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:07.584640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:07.584640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:07.584640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:07.584640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:07.587097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 268/546] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:07.592834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:07.742536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d8ddd-76a3-45da-96df-d71b49589aeb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:07.759306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:07.796868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:07.797511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:07.797794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:07.798067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:07.798761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:07.799067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:07.800465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:07.820644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 279/547] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:07.826250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:07.940144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b235b6-fd6c-42c1-a57f-b5925e2f789c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:07.964263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:07.976389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:07.977326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:07.977833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:07.978325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:07.986245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:07.987937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:08.000279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:08.001274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:08.002683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:08.005404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 269/548] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:08.011539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:08.129085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b7fe-c687-409b-9bd1-9c45738ad40d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:08.170787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111d3dd-05f1-4729-8b90-e488f6bbf574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:08.171446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111d3dd-05f1-4729-8b90-e488f6bbf574 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.171731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111d3dd-05f1-4729-8b90-e488f6bbf574 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.172007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111d3dd-05f1-4729-8b90-e488f6bbf574 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.172814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111d3dd-05f1-4729-8b90-e488f6bbf574 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:08.173131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111d3dd-05f1-4729-8b90-e488f6bbf574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:08.174587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111d3dd-05f1-4729-8b90-e488f6bbf574 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:08.200555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 280/549] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 04:05:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:08.208331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:08.323356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952153a-6e39-4614-b9ef-d4630b3a0d2c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:08.360578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:08.361499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.361932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.362368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.414752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:08.423914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dde7f-82d3-4893-92ea-0616ce805c98 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.424205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dde7f-82d3-4893-92ea-0616ce805c98 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.424487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dde7f-82d3-4893-92ea-0616ce805c98 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.427054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 281/550] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:08.431666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371461f-57c9-4b28-beb0-4fa2f09b7dfb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.431956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371461f-57c9-4b28-beb0-4fa2f09b7dfb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.432238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371461f-57c9-4b28-beb0-4fa2f09b7dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.436029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:08.452804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8371461f-57c9-4b28-beb0-4fa2f09b7dfb None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:08.454095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8371461f-57c9-4b28-beb0-4fa2f09b7dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:08.483689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:08.531859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 282/551] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:05:08.550912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371461f-57c9-4b28-beb0-4fa2f09b7dfb None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:08.552405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 270/552] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:08.558108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:08.643506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:08.662845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb393db-5ba8-4923-b949-0a3c46f1ba9e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:08.699750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:08.700808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.701297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.701776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.712666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:08.714445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:08.732883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:08.733920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:08.734824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:08.734824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:08.734824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:08.734824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:08.737079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 271/553] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:08.748940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:08.766010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371461f-57c9-4b28-beb0-4fa2f09b7dfb None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:08.812595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78b8f2-e522-474d-a217-4ab3d31a39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:08.813243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b8f2-e522-474d-a217-4ab3d31a39e4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.813524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b8f2-e522-474d-a217-4ab3d31a39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.813799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b8f2-e522-474d-a217-4ab3d31a39e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.826100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78b8f2-e522-474d-a217-4ab3d31a39e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-fb78b8f2-e522-474d-a217-4ab3d31a39e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:08.831335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:08.832284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:08.833129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:08.836115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 283/554] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:08.837705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea83f-cf1d-4e00-b3a7-f8923cbb6b8a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.838221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea83f-cf1d-4e00-b3a7-f8923cbb6b8a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.838757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea83f-cf1d-4e00-b3a7-f8923cbb6b8a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.840718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 284/555] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:08.842510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea83f-cf1d-4e00-b3a7-f8923cbb6b8a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:08.859420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86756fe4-b112-42f2-8f07-7cd688e03d2b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:08.868417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:08.896156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bc07-b733-49b8-b626-f79634c066e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:08.896694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bc07-b733-49b8-b626-f79634c066e6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.896976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bc07-b733-49b8-b626-f79634c066e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.897294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bc07-b733-49b8-b626-f79634c066e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.898196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bc07-b733-49b8-b626-f79634c066e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:08.898306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bc07-b733-49b8-b626-f79634c066e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:08.899704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bc07-b733-49b8-b626-f79634c066e6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:08.901186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:08.917658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 272/556] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:08.917658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de85d1d-d24b-4abc-9fa6-bdd2d4388af3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:08.917658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de85d1d-d24b-4abc-9fa6-bdd2d4388af3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:08.917658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de85d1d-d24b-4abc-9fa6-bdd2d4388af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:08.935654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0de85d1d-d24b-4abc-9fa6-bdd2d4388af3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:08.936363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0de85d1d-d24b-4abc-9fa6-bdd2d4388af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:08.968001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea83f-cf1d-4e00-b3a7-f8923cbb6b8a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.004912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.006007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.006501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.007583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.008254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 273/557] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:09.008784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:09.009300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de85d1d-d24b-4abc-9fa6-bdd2d4388af3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.009411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.011294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.020728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 285/558] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:09.026550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.125516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de85d1d-d24b-4abc-9fa6-bdd2d4388af3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.140589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.163829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.164905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b6f2-d258-4a88-b594-0ca3c72ffb09 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.178353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.179166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.179486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.179764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.186794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.188275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:09.199940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:09.200814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:09.201756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 274/559] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:09.202236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.208814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69ba19-8305-49b9-a498-742b91e100f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.210132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69ba19-8305-49b9-a498-742b91e100f9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.210592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69ba19-8305-49b9-a498-742b91e100f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.210870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69ba19-8305-49b9-a498-742b91e100f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.222760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69ba19-8305-49b9-a498-742b91e100f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.224358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69ba19-8305-49b9-a498-742b91e100f9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-fc69ba19-8305-49b9-a498-742b91e100f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:09.240743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:09.242470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:09.243732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:09.243732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:09.243732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:09.243732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:09.247304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 286/560] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:09.248760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae49ce6-84b3-4995-88f3-ad5b048a80fe None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.249022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae49ce6-84b3-4995-88f3-ad5b048a80fe None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.249383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae49ce6-84b3-4995-88f3-ad5b048a80fe None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.254729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 287/561] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:09.254729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae49ce6-84b3-4995-88f3-ad5b048a80fe None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.307098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774632b9-faa4-4ceb-888f-85d8ba8f557f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.342387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.343032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.343345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.343627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.354131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:09.359480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:09.360400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:09.361252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 275/562] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:09.362025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.368823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae49ce6-84b3-4995-88f3-ad5b048a80fe None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.399992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.405099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5708038-8d08-4944-9d3a-ccc34823b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.405725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5708038-8d08-4944-9d3a-ccc34823b221 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.406009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5708038-8d08-4944-9d3a-ccc34823b221 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.406306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5708038-8d08-4944-9d3a-ccc34823b221 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.407041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5708038-8d08-4944-9d3a-ccc34823b221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:09.407381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5708038-8d08-4944-9d3a-ccc34823b221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.408832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5708038-8d08-4944-9d3a-ccc34823b221 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.418754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.425333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 288/563] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:09.425333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84336-a5de-4ccb-aaf0-25ef8d413923 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.425333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84336-a5de-4ccb-aaf0-25ef8d413923 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.425333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84336-a5de-4ccb-aaf0-25ef8d413923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.441834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b2d84336-a5de-4ccb-aaf0-25ef8d413923 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:09.443044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b2d84336-a5de-4ccb-aaf0-25ef8d413923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:09.488659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b9907-968a-4ad3-8b16-975ea19fa4f3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.512724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 289/564] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:09.513581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d84336-a5de-4ccb-aaf0-25ef8d413923 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.523072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.523728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.524178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.525123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.525123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:09.525444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.526824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.538714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 276/565] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:09.539581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.626380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d84336-a5de-4ccb-aaf0-25ef8d413923 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.638024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a051436-8b50-4050-8788-c1dc50ba92cc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.640379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.649478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.661259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e3eb1-074e-46cd-b173-1d714609a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.661876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e3eb1-074e-46cd-b173-1d714609a457 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.662158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e3eb1-074e-46cd-b173-1d714609a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.662437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e3eb1-074e-46cd-b173-1d714609a457 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.663778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e3eb1-074e-46cd-b173-1d714609a457 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:09.664171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e3eb1-074e-46cd-b173-1d714609a457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.665545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e3eb1-074e-46cd-b173-1d714609a457 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.673982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 290/566] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:09.674162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.674572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.674852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.675079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a0ba-399e-4183-94e1-764bd7fdd442 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.675176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.675392 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a0ba-399e-4183-94e1-764bd7fdd442 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.675672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a0ba-399e-4183-94e1-764bd7fdd442 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.675934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=11cd9091a4654f5eb689e23061b6e52e) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:09.676245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.679409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 291/567] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:09.679539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.679621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2a0ba-399e-4183-94e1-764bd7fdd442 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.684072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 277/568] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/role_assignments?user.id=11cd9091a4654f5eb689e23061b6e52e&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:09.684868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.804137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d4cd-389c-430c-a1c6-6ff3c830545d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.811964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2a0ba-399e-4183-94e1-764bd7fdd442 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:09.841607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.842407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.842687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.843822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.851945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:09.853402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:09.857074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe8277-771e-40c2-829f-33ed7bd5bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:09.857724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe8277-771e-40c2-829f-33ed7bd5bc1a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.858007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe8277-771e-40c2-829f-33ed7bd5bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.858282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe8277-771e-40c2-829f-33ed7bd5bc1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:09.864666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:09.866044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:09.867038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 278/569] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:09.867710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.875229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe8277-771e-40c2-829f-33ed7bd5bc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-febe8277-771e-40c2-829f-33ed7bd5bc1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:09.880951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:09.882451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:09.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 292/570] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:09.885841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0dc8-98a1-4273-905d-04cda48c3630 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:09.885841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0dc8-98a1-4273-905d-04cda48c3630 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:09.885841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0dc8-98a1-4273-905d-04cda48c3630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:09.902817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a79e0dc8-98a1-4273-905d-04cda48c3630 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:09.904070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a79e0dc8-98a1-4273-905d-04cda48c3630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:09.905528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.947115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:09.983327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 293/571] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:09.983327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0dc8-98a1-4273-905d-04cda48c3630 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:09.995090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dd487-a63a-4f82-a0fd-e3c2ba6fb60d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.035551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.036345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.036625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.037042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.048967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.050411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:10.066456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:10.067434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:10.068377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:10.068377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:10.068377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:10.068377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:10.068377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 279/572] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:10.068667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.095855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0dc8-98a1-4273-905d-04cda48c3630 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.143651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.144274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.144560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.144835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.145628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:10.145934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.148077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.154834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:10.172632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 294/573] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:05:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:10.172632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.183184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037ccd-7df0-4903-a6e0-7f7454c52816 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.202967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:10.220025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.220831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.221127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.221472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.222259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:10.222632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.224152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.237129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 280/574] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:10.237129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.282882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7008f8-8314-4199-99dc-16ae44feed53 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.318738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.320705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.320982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.321251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.331729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:10.336662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:10.337593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:10.338437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 295/575] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:10.339165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.351995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6727-95b6-4b38-9822-3f9d2a612b92 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.390282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.391012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.391313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.391711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.392400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:10.392706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.394072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.410673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 281/576] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:10.410673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.411486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:10.451332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:10.463093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27176d-0042-4c43-8192-f0601e94f7cd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.500735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.501365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.501645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.501916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.512400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb34af-163c-4a4c-bd59-d5f9cd8400bd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.512819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.514262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:10.530316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:10.531246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:10.532203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:10.532203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:10.532203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:10.532203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:10.532203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 296/577] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:10.532483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.554904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.555571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.555850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.556127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.566955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.568434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:10.583926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:10.585783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:10.586732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:10.586732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:10.586732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:10.586732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:10.586732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 282/578] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:10.586732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.647913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b53518-37e8-433d-98d6-0ff5d5a6011d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.648141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:10.685167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.686057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.686337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.686611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.688023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:10.688341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.690259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.696652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ab3c-f9df-4ef7-8afc-e499113fc1b0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.705587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 297/579] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:10.705587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.717253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:10.736760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.737412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.737722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.737973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.748960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.750414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:10.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:10.763606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:10.764773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 283/580] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:10.765378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.827774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6db400-1889-4f86-9dc3-6de0555abdff None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.865179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.865802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.866156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.866436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.867596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:10.867920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.869489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.880977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e38e22-d151-4d21-90cc-36a81fc2a38c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:10.887199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 298/581] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:10.888111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.897894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:10.922791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:10.923585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:10.923949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:10.924294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:10.925097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:10.925409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:10.926798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:10.939502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 284/582] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:10.940311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:10.963417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.002399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaca99-0dff-4500-a877-d8e51b1789a2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.038290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.038929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.039206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.039509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.043988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e80712-7c46-4661-a53f-b3dd17f3aad3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.050333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.051944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:11.068160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:11.069156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:11.070219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:11.070219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:11.070219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:11.070219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:11.070219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 299/583] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:11.070219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.087122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.087774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.088058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.088340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.089135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:11.089443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.091137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.110764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 285/584] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 04:05:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:11.111841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.153657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.172561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93280d6e-5a98-41bb-8d42-d4c175012a53 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.191698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.211785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.212433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.212717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.212994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.220133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.221588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.230152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26fddb-b37a-4459-b2d8-31e1989a7e0c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:11.233160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:11.234157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 300/585] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:11.235122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.273466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.274107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.274387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.274664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.281883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.283348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:11.296038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:11.297023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:11.298384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 286/586] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:11.300919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.351250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f304f44-d27a-41df-8862-473dda1875e9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.390128 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.390877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.391162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.391589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.392292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:11.392600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.393975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.399689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.406951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 301/587] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:11.408129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.415890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a3f10-e664-43a9-bf9e-3439bb76335e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.449773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.455915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.456671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.456949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.457344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.469144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.470637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:11.485665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:11.486624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:11.487594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:11.487594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:11.487594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:11.487594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:11.487594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 287/588] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:11.487889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.517280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b301e-4c0b-4496-a783-2f2d021550b8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.554766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.555191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.555520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.555839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.556553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:11.556863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.558317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.576109 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 302/589] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:11.576109 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.602873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59e4b-440c-4fd0-9c9d-a2751a31ff72 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.640457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.641082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.641367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.641646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.642438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:11.642749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.644232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.664068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 288/590] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:11.668277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.670988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.685790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.690186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547d92-5770-4853-8476-bc2711224f38 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.724791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.725993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.726271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.726539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.734110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.735608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:11.746749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:11.747750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:11.748681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 303/591] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:11.749299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.778436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a446205-81ab-4ca0-8dcc-f4baf7a55749 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.812945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.813490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.813765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.814037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.814713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:11.815014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.816422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.828001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 289/592] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:11.828809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.849744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c82b8-8349-49ff-9a5e-00b5722a2c44 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.882698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722d90e-438c-45fb-acfe-18aece1eb088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.883382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d90e-438c-45fb-acfe-18aece1eb088 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.883662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d90e-438c-45fb-acfe-18aece1eb088 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.883934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722d90e-438c-45fb-acfe-18aece1eb088 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a61ebb13ad8c483fa715e5f6906b05f0/roles/ee92e7b31add479ea825c953e000b04d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.893291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.900134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722d90e-438c-45fb-acfe-18aece1eb088 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=a61ebb13ad8c483fa715e5f6906b05f0, role_id=ee92e7b31add479ea825c953e000b04d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:11.901573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722d90e-438c-45fb-acfe-18aece1eb088 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:11.913706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 304/593] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:11 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a61ebb13ad8c483fa715e5f6906b05f0/roles/ee92e7b31add479ea825c953e000b04d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:05:11.914902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d7322-f14a-4edd-8490-d5292dd8914c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.915183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d7322-f14a-4edd-8490-d5292dd8914c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.915488 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d7322-f14a-4edd-8490-d5292dd8914c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:11.916892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 305/594] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:11.917436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d7322-f14a-4edd-8490-d5292dd8914c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:11.929303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:11.950685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438d0e-6802-45d9-b4be-c27e780b8557 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:11.993154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:11.994230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:11.994723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:11.995200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.007389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.009319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:12.025886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:12.027015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:12.028138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:12.028138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:12.028138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:12.028138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:12.033576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 290/595] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:12.034901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.035763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d7322-f14a-4edd-8490-d5292dd8914c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.081256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099647-df8c-4e70-9a6b-6b78dcfe7ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.081804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099647-df8c-4e70-9a6b-6b78dcfe7ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.082089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099647-df8c-4e70-9a6b-6b78dcfe7ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.082367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099647-df8c-4e70-9a6b-6b78dcfe7ef3 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.083188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099647-df8c-4e70-9a6b-6b78dcfe7ef3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:12.083509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099647-df8c-4e70-9a6b-6b78dcfe7ef3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.085003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099647-df8c-4e70-9a6b-6b78dcfe7ef3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.103775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 306/596] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jul 27 04:05:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:12.105049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887188b5-ea91-41d8-97b6-5785333d425c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.105338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887188b5-ea91-41d8-97b6-5785333d425c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.105617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887188b5-ea91-41d8-97b6-5785333d425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.125451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-887188b5-ea91-41d8-97b6-5785333d425c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:12.126705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-887188b5-ea91-41d8-97b6-5785333d425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:12.159150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d1c13-1f32-4c59-9be8-a5017e14389f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.174726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:12.191527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:12.198932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.199608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.199896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.200404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 307/597] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:12.201054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887188b5-ea91-41d8-97b6-5785333d425c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.211415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.221642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.224013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:12.236305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:12.237381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:12.238483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 291/598] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:12.239092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.309648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887188b5-ea91-41d8-97b6-5785333d425c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.345547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.345767 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcb9e7-d5ed-4407-a671-147fde9fce47 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.346225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.346567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.346909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.347629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:12.347936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.349309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.366884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 308/599] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:12.366884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.387617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.388354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.388635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.388907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.400969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.402410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:12.417914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:12.419035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:12.424698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:12.424698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:12.424698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:12.424698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:12.424698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 292/600] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:12.424698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.432882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:12.452103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:12.492292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed32b-38c7-4b06-9e18-397e52109d64 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.529227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441b748-db2f-4a94-8bb0-b1417f25f879 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.530659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.531352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.531602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.532537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.543192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:12.548480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:12.549414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:12.550276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 309/601] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:12.550970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.573773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.574743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.575279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.575678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.576531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:12.576954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.578438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.590539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 293/602] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:12.591514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.671895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cf9bf-ddb7-48cc-9098-6f0e800bc600 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.688684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:12.689098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:12.706501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5efcf1-d3c1-46f8-b456-bc845cc5fa4f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.710180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.710964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.711387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.711787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.718832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.720404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:12.734490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:12.735616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:12.736727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:12.743326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 310/603] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:12.743326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.750115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.750840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.751230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.751651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.752354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:12.752661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.754030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.770256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 294/604] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:12.770256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.871762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddd491-4abd-4e60-9beb-d69e6378b7aa None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.874344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2686a-47ba-49b7-8a83-8c8cd9fcb214 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:12.908444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.909396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.909746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.910082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.910857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:12.911229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.912685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.915546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:12.916061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:12.916358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:12.916638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/046b235e211744b0bfe631e0acf4d6e4/roles/ee92e7b31add479ea825c953e000b04d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:12.927525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 311/605] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:12.928050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.933776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=046b235e211744b0bfe631e0acf4d6e4, role_id=ee92e7b31add479ea825c953e000b04d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:12.935230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:12.938384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:12.950697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 295/606] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:12 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/046b235e211744b0bfe631e0acf4d6e4/roles/ee92e7b31add479ea825c953e000b04d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:05:12.951785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:12.985305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:13.060327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b325d-c517-4d9a-a00b-2ef68c52749d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.101385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.102017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.102300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.102577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.103379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:13.103688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.105177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.116595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c0d4b-c5c8-4c18-81d9-94ccd17c8b25 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.119512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 312/607] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:13.120662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:13.159858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.160838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.161307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.161767 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.169325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.171012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:13.183684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:13.184605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:13.185539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:13.188200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 296/608] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:13.189215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:13.233036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:13.237799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c484e-307f-45e8-ab35-49b3f0c8a487 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.248258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:13.279449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.280485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.280910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.281336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.292991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.294501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548b44-3de9-4623-8498-5f8c1fbb88c6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.294812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:13.311228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:13.312377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:13.313464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:13.313464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:13.313464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:13.313464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:13.315527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 313/609] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:13.316539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:13.333898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.334872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.335183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.335570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/c2d3a3a7c1f545e593e7956ec79f25ea/roles/ee92e7b31add479ea825c953e000b04d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.352041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=c2d3a3a7c1f545e593e7956ec79f25ea, role_id=ee92e7b31add479ea825c953e000b04d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.353503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.370230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 297/610] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:13 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/c2d3a3a7c1f545e593e7956ec79f25ea/roles/ee92e7b31add479ea825c953e000b04d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:05:13.371248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:13.497690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c24f0-6cf1-4b4f-9b3d-0dcb936d78e2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.545268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.546401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.546902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.547177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.548106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:13.548445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.550172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.564872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 314/611] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:13.572018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:13.581640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242a72f-ecca-4078-a4da-456451a792c7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.589049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:13.591689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:13.623863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.624500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.624785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.625062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.625761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:13.626068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.627653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.643543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 298/612] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:13.653402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:13.727722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ab9fc-20a5-4a87-b2e1-cfd8a9aa7c43 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.776023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.776719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.777005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.777287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/e90c842029d845bd8b4f12696354af78/roles/ee92e7b31add479ea825c953e000b04d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.813209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=e90c842029d845bd8b4f12696354af78, role_id=ee92e7b31add479ea825c953e000b04d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.814672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.838003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34adb62-51e2-40a4-b09e-649deb26e1e8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:13.852127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 315/613] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:13 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/e90c842029d845bd8b4f12696354af78/roles/ee92e7b31add479ea825c953e000b04d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:05:13.879102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9cc8-ea61-4b82-9f2c-5023fc9b8e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:13.879870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9cc8-ea61-4b82-9f2c-5023fc9b8e2f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:13.880155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9cc8-ea61-4b82-9f2c-5023fc9b8e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:13.880432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9cc8-ea61-4b82-9f2c-5023fc9b8e2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:13.890183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9cc8-ea61-4b82-9f2c-5023fc9b8e2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:13.891770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9cc8-ea61-4b82-9f2c-5023fc9b8e2f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7b7c9cc8-ea61-4b82-9f2c-5023fc9b8e2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:13.905126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:13.906162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:13.907105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 299/614] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:13.912371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:14.022658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:14.080216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa3ee-e78d-4cc8-aa4b-3352bb7fe81f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:14.090661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b606b1-8e4d-4c0f-b4e6-ca2e40754b03 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.091661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b606b1-8e4d-4c0f-b4e6-ca2e40754b03 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.092189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b606b1-8e4d-4c0f-b4e6-ca2e40754b03 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.093734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 300/615] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:14.098880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7e74-26ea-4b26-847a-36e929159e86 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.099169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7e74-26ea-4b26-847a-36e929159e86 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.099474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7e74-26ea-4b26-847a-36e929159e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.123083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:14.123956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.124399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.124850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.125824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:14.126289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:14.127929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:14.140286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-847b7e74-26ea-4b26-847a-36e929159e86 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:14.141505 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-847b7e74-26ea-4b26-847a-36e929159e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:14.149582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 316/616] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 04:05:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:14.155070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:14.177198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:14.281137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544106-e2e8-4e2a-8ddc-86f868653e2b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:14.296842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 301/617] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:14.316782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:14.342450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:14.343014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.343305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.343580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.360429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:14.361902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:14.379575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b7e74-26ea-4b26-847a-36e929159e86 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:14.381225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:14.382129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:14.383035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:14.383035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:14.383035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:14.383035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:14.383657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 317/618] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:14.389005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:14.503174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe453a-afa7-4934-8f86-da2d31f14b21 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:14.542065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:14.542686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.542965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.543312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.544141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:14.544495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:14.545857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:14.563555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 318/619] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:14.564745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:14.599890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:14.658340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b7e74-26ea-4b26-847a-36e929159e86 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:14.674905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c42b5-196e-40f6-a54e-22363a7d972f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:14.712252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:14.712897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.713177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.713716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.720764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:14.733027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:14.755468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:14.755468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.755468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.755468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:14.763045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:14.763977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:14.764929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:14.767651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 319/620] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:14.770526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:14.772242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:14.779122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:14.782215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:14.784237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:14.789662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 302/621] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:14.792794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:14.835848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:14.883483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:14.894897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64d289-7838-4585-91b2-329306332b82 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:14.947992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:14.949425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:14.949941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:14.950420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:14.951409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:14.951923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:14.953584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:14.964400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af53c44-e22a-42c7-92d0-5382c75af9d6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:14.967905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 320/622] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:14.978799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:15.031249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:15.031899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.032187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.032496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.033168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:15.033468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:15.034824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:15.058332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 303/623] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:15.068283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:15.090138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa98fc-6a68-4ab0-8210-bf862b679e2c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:15.141439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:15.142046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.142344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.142597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/11cd9091a4654f5eb689e23061b6e52e/roles/ee92e7b31add479ea825c953e000b04d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.177051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=11cd9091a4654f5eb689e23061b6e52e, role_id=ee92e7b31add479ea825c953e000b04d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:15.179105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:15.204874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:15.213023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 321/624] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:14 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/11cd9091a4654f5eb689e23061b6e52e/roles/ee92e7b31add479ea825c953e000b04d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:05:15.213618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:15.242828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b14808-ba91-40d3-af50-b1149c83da95 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:15.300132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1208f-be1c-45a9-a49a-46bb9f27a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:15.300803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1208f-be1c-45a9-a49a-46bb9f27a641 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.301082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1208f-be1c-45a9-a49a-46bb9f27a641 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.301353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1208f-be1c-45a9-a49a-46bb9f27a641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.313889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1208f-be1c-45a9-a49a-46bb9f27a641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:15.315379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1208f-be1c-45a9-a49a-46bb9f27a641 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6ec1208f-be1c-45a9-a49a-46bb9f27a641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:15.332005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:15.332991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:15.333898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:15.333898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:15.333898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:15.333898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:15.333898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 304/625] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:15.340305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:15.403682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2aa42-b77c-4732-8585-5804191b4a59 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.403878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2aa42-b77c-4732-8585-5804191b4a59 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.404138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2aa42-b77c-4732-8585-5804191b4a59 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.405505 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 305/626] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:15.411143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5340b-d951-43db-acc0-35004216e1f4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.411460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5340b-d951-43db-acc0-35004216e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.411741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5340b-d951-43db-acc0-35004216e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.446539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4bc5340b-d951-43db-acc0-35004216e1f4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:15.447831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4bc5340b-d951-43db-acc0-35004216e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:15.488102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673fc8-7980-49c4-8b1a-56aabf4ef0c0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:15.528648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:15.529664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.530163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.530640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.531566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:15.532074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:15.533661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:15.541162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 306/627] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:15.548206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 322/628] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:15.553348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5340b-d951-43db-acc0-35004216e1f4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:15.566553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:15.622878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:15.672359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:15.674040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5340b-d951-43db-acc0-35004216e1f4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:15.713086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:15.713891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.714983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.715286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.730204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:15.731700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:15.750819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:15.751832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:15.752905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 307/629] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:05:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:15.759280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:15.833209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d896ce7-50ba-43e7-8017-f87b5a4cb522 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:15.871405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1de35-eb8c-493f-a806-38f7a0892cff None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:15.895665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:15.910005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553f147-9f27-4b1e-be38-33205a747c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:15.910641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f147-9f27-4b1e-be38-33205a747c15 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.912310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f147-9f27-4b1e-be38-33205a747c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.912310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f147-9f27-4b1e-be38-33205a747c15 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.912310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f147-9f27-4b1e-be38-33205a747c15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:15.913372 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f147-9f27-4b1e-be38-33205a747c15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:15.916040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f147-9f27-4b1e-be38-33205a747c15 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:15.923326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022531a-4517-4cef-b57f-d438450328f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:15.924264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022531a-4517-4cef-b57f-d438450328f3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.924747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022531a-4517-4cef-b57f-d438450328f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.925241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022531a-4517-4cef-b57f-d438450328f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.936125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022531a-4517-4cef-b57f-d438450328f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:15.937893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 308/630] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:05:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:15.939155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466889d-55bb-4908-a961-225f94b74175 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7022531a-4517-4cef-b57f-d438450328f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:15.942381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:15.943632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:15.945355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:15.946034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466889d-55bb-4908-a961-225f94b74175 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.946034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466889d-55bb-4908-a961-225f94b74175 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.950410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 309/631] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:15.950410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466889d-55bb-4908-a961-225f94b74175 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:15.952416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 323/632] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:15.954213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ddd6-7b97-4324-9741-0647b4a9dfbf None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:15.954703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ddd6-7b97-4324-9741-0647b4a9dfbf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:15.955179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ddd6-7b97-4324-9741-0647b4a9dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:15.974059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7b99ddd6-7b97-4324-9741-0647b4a9dfbf None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:15.976462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7b99ddd6-7b97-4324-9741-0647b4a9dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:16.055513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 324/633] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:16.056702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99ddd6-7b97-4324-9741-0647b4a9dfbf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.079309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466889d-55bb-4908-a961-225f94b74175 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.121261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.122127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.122408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.122679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.127152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.180640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99ddd6-7b97-4324-9741-0647b4a9dfbf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.187654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.215897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.217356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.218494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.219380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.219878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.220385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.221300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:16.221804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.223408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.232593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 325/634] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:16.233721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.337397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 310/635] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 04:05:16.338613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.371021 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d9b8-9c80-4216-977c-a1598a586aef None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.384541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.408755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.409320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.409596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.409863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.422169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:16.424933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:16.429199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:16.430333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:16.431463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:16.435672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 326/636] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:16.436537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.452612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe2131-f5f0-42d6-b111-09a5065201a6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.488961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862428f7-f4b9-45a6-87a0-43e0fe81774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.489636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862428f7-f4b9-45a6-87a0-43e0fe81774c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.489916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862428f7-f4b9-45a6-87a0-43e0fe81774c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.490191 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862428f7-f4b9-45a6-87a0-43e0fe81774c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.500614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862428f7-f4b9-45a6-87a0-43e0fe81774c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.502059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862428f7-f4b9-45a6-87a0-43e0fe81774c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-862428f7-f4b9-45a6-87a0-43e0fe81774c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:16.518292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:16.519255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 311/637] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16407-abe8-4587-9cee-4eaf91e0ee04 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16407-abe8-4587-9cee-4eaf91e0ee04 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16407-abe8-4587-9cee-4eaf91e0ee04 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.525651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 312/638] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:16.526175 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed16407-abe8-4587-9cee-4eaf91e0ee04 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.552794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6e32f-92f4-4945-b66e-0a701bdf54cc None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.588850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.589524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.589803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.590075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.603701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.605405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:16.620833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:16.621880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:16.622779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:16.622779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:16.622779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:16.622779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:16.622779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 327/639] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:16.622779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.649910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed16407-abe8-4587-9cee-4eaf91e0ee04 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.650560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.684198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.691402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626d13f-1ca7-4721-81c8-fd823e880dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.692036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626d13f-1ca7-4721-81c8-fd823e880dcd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.692322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626d13f-1ca7-4721-81c8-fd823e880dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.692597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626d13f-1ca7-4721-81c8-fd823e880dcd None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.693313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626d13f-1ca7-4721-81c8-fd823e880dcd None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:16.693621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626d13f-1ca7-4721-81c8-fd823e880dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.695568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626d13f-1ca7-4721-81c8-fd823e880dcd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.708985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 313/640] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:16.710480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683f1a4-130f-4b32-8da0-873aa7e0f83e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.710761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683f1a4-130f-4b32-8da0-873aa7e0f83e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.711039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683f1a4-130f-4b32-8da0-873aa7e0f83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.730581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5683f1a4-130f-4b32-8da0-873aa7e0f83e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:16.732109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5683f1a4-130f-4b32-8da0-873aa7e0f83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:16.741410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90dca2-de6c-416b-8067-591f6ed21bda None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.783489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.784227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.784512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.784789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.785481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:16.785790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.787424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.811293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 314/641] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:16.811293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683f1a4-130f-4b32-8da0-873aa7e0f83e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.811563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 328/642] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:16.811563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.904999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.922752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683f1a4-130f-4b32-8da0-873aa7e0f83e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.923224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4c8e8-e800-4896-98ed-f17bbfc126f9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:16.948158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:16.962635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.963441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:16.963890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.963890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.964194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.964435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:16.964889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:16.964986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:16.965236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.965332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:16.966909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.978507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:16.980011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:16.983327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 315/643] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:16.984415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:16.995754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:16.996749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:16.997682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:16.997682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:16.997682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:16.997682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:16.999549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 329/644] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:17.000870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.094358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd07563-f031-43d1-a269-1a79767d571c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.114130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e334a58-4adc-495e-8e9a-fb90ec3f4690 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.136197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.136834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.137141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.137376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.145005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.146422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.150977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.151649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.151931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.152299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.155184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:17.157540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:17.158920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 316/645] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:17.160124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.170640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:17.176796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:17.177734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:17.179181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 330/646] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:17.179967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.212548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.273194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc9075-9ab6-4f15-9a72-be458c225be4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.285523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5b666-3ef7-4a29-933a-07169333c1ae None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.309529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.310165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.310443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.310716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.317400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.319364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.322149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.322764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.323046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.323353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.324046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:17.324356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.326086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:17.330743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:17.331697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:17.332630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:17.335575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 317/647] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:17.337163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.343957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 331/648] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:17.343957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.404833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.452208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52227ea9-6af7-402b-8078-f4805215a581 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.453759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.454362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903053d4-6a04-4bfb-a178-1c7fbed4392b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.487581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.488120 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.488403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.488681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.489474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:17.489788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.491903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.494347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.495050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.495431 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.495775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.496561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:17.496940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.498369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.507150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 332/649] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:17.508060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.518201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 318/650] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:17.518201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.608846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc9be9-52b0-4dd2-b7ab-b9e2fd36a3c4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.612090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a7e52-7c3a-4183-b1b2-aa1176beab22 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.625724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.643417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.644031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.644306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.644576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.645311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:17.645613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.646345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.647530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.647694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.647802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.648075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.655002 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.656458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.659352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 333/651] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:17.660272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:17.670070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:17.671080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 319/652] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:17.672116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.696696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.774150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88dc3d-4d9f-49ab-a112-7e36e4db8622 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.777167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4500a-626c-4331-b388-51bde0a391ae None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.807895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e9cb-ecad-41c8-b9df-27a8118f11ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.808535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e9cb-ecad-41c8-b9df-27a8118f11ee None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.808816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e9cb-ecad-41c8-b9df-27a8118f11ee None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.809090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e9cb-ecad-41c8-b9df-27a8118f11ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.810608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.811416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.812008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.812290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.819643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e9cb-ecad-41c8-b9df-27a8118f11ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.821245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e9cb-ecad-41c8-b9df-27a8118f11ee None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-3cb4e9cb-ecad-41c8-b9df-27a8118f11ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:17.835840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:17.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:17.837774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:17.837774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:17.837774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:17.837774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:17.837774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 334/653] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:17.838220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a2a6-69b2-4a6c-aaa3-43d0be812690 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.838407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a2a6-69b2-4a6c-aaa3-43d0be812690 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.838688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a2a6-69b2-4a6c-aaa3-43d0be812690 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.839952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 335/654] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:17.840647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a2a6-69b2-4a6c-aaa3-43d0be812690 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.872232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.886681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.888167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.907802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:17.944775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a2a6-69b2-4a6c-aaa3-43d0be812690 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:17.977301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:17.977926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:17.978173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:17.978446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:17.979228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a61ebb13ad8c483fa715e5f6906b05f0) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:17.979570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:17.981029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:17.985503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 320/655] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:17.986340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:17.996793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 336/656] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/role_assignments?user.id=a61ebb13ad8c483fa715e5f6906b05f0&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:17.996793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.096847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.105237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89e28-721c-43e8-8ea5-8bad159d394e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.108221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c800-8d09-4cd1-bc55-2de87323b147 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.133823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.141235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852cfab-681b-43b9-943a-fefc656eb4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.141864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852cfab-681b-43b9-943a-fefc656eb4ca None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.142151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852cfab-681b-43b9-943a-fefc656eb4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.142429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852cfab-681b-43b9-943a-fefc656eb4ca None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.143131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852cfab-681b-43b9-943a-fefc656eb4ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:18.143477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852cfab-681b-43b9-943a-fefc656eb4ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.144845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852cfab-681b-43b9-943a-fefc656eb4ca None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.155718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.156348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.156630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.156904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.157699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:18.158008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.159715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 337/657] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:18.159868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.160146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf8ec-8a1a-41c0-8d0c-17e1668ea568 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.160388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf8ec-8a1a-41c0-8d0c-17e1668ea568 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.160755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf8ec-8a1a-41c0-8d0c-17e1668ea568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.179674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 321/658] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 04:05:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:18.180534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.181754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-050bf8ec-8a1a-41c0-8d0c-17e1668ea568 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:18.182966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-050bf8ec-8a1a-41c0-8d0c-17e1668ea568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:18.264916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 338/659] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:18.265999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf8ec-8a1a-41c0-8d0c-17e1668ea568 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.299902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbbb82-d83b-4aae-ae8c-79ca834fc2f8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.338302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.338953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.339237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.339541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.349847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.351480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.359130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:18.368074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:18.369222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:18.370147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:18.370147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:18.370147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:18.370147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:18.370147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 322/660] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:18.370428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.382934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf8ec-8a1a-41c0-8d0c-17e1668ea568 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.405109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.425769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.426416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.426699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.426977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.434850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.436342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:18.448650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:18.449642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 339/661] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:18.450599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.484908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47002f-0418-4691-be08-4f1138583fca None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.522393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.523001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.523300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.523583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.560411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f05f1c-d98e-4c49-b2af-defe161b60b8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.596103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.597559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.597935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.598577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.598860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.599424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.614044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:18.620843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:18.621881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 340/662] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:18.622741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.627723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.634543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.710597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 323/663] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:18.711479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.747832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a036f1-5452-4ab9-8788-15986f33911c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.784370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.784930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.785172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.785449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.786143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:18.786455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.788137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.804800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 341/664] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:18.804800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.829522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294c360-e6de-4b56-a35c-b0ee395ecbf8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.860529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.867406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.868044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.868324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.868600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.869384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:18.869689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.871154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.872336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:18.894249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 324/665] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:18.894249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.922475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053fc34-b087-46de-b2f1-669f887d0012 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:18.962125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:18.962844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:18.963027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:18.963313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:18.964036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:18.964347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:18.965789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:18.974062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 342/666] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:18.979372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:18.999045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f52e8-d6cd-4b36-a87b-b91d0f6ea3aa None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.037916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.038485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.038772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.039049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.049720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.051160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:19.067080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:19.068219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:19.069795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:19.069795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:19.069795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:19.069795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:19.069795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 325/667] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:19.069795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.092706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233cd97-d704-4a13-aff3-4fd2b4462586 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.114602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.125129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.135860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.136576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.136857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.137132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.144688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.146134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:19.158752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:19.159773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:19.160701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 343/668] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:19.161729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.187602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afc3a-bb42-480f-b63f-a4181e1b283f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.224262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.225712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.226143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.226565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.266704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b451e8-328f-4732-a715-507d1d57e84b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.301614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.302328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.302614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.302908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.304923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.306910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.314605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.316090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:19.330965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:19.332096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:19.333009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:19.333009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:19.333009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:19.333009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:19.333009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 344/669] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:19.333009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.356221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.379096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.421425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 326/670] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:19.422110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.447554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b377af-cdff-4e42-b958-4e6fbaf72e53 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.483096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.483744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.484029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.484316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.485011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:19.485323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.486714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.502701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 345/671] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:19.502701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.530078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ac6b8-9318-4cf5-91f9-5060143747f1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.567624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.568174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.568458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.569268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.570739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:19.571058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.573451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.585911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.594925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 327/672] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:19.596045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.603472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.608037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c662-62b9-42aa-9426-d7eaba4146b0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.645680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.646306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.646613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.646937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.647848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:19.648162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.650286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.664920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 346/673] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:19.669994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.705066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8741102-a7e0-4ab0-956e-eeed697c117b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.747708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.748449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.748751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.748930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.761318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.762781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:19.779309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:19.780261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:19.781222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:19.781222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:19.781222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:19.781222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:19.781222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 328/674] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:19.781222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.788701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5238c3-5d04-4f65-ae66-0b43dd4b1ae9 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.825105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.825817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.826106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.826396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.833959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.836068 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.837878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:19.847729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:19.848682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:19.849596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 347/675] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:19.850145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.873968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:19.898404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56483cb-a7ba-44fb-bd62-dce21cc82be3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:19.936301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:19.937333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:19.937626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:19.937903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:19.938696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=046b235e211744b0bfe631e0acf4d6e4) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:19.939404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:19.941195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:19.948698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 329/676] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/role_assignments?user.id=046b235e211744b0bfe631e0acf4d6e4&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:19.949732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:19.964986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a60787-4fee-4128-a522-73bd8b87061f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.012745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.013421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.013687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.013958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.025884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.025884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:20.039409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:20.040541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:20.041490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 348/677] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:20.042203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.105070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f61dc-def7-4484-9453-1a5c4b0595a3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.123544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:20.141048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:20.148065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.149618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.149618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.149618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.149976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:20.150227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.151634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.166188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 330/678] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:20.168164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.173527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d846d-516e-4098-991f-9f09a92994b1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.212966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73342d8b-854d-4db6-bac7-e08d35c44f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.213590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342d8b-854d-4db6-bac7-e08d35c44f9b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.213875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342d8b-854d-4db6-bac7-e08d35c44f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.214150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342d8b-854d-4db6-bac7-e08d35c44f9b None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.214907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73342d8b-854d-4db6-bac7-e08d35c44f9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:20.215216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73342d8b-854d-4db6-bac7-e08d35c44f9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.216709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73342d8b-854d-4db6-bac7-e08d35c44f9b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.229580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 349/679] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:20.230886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5096-c0b7-449b-af4e-3206a822eb01 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.231175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5096-c0b7-449b-af4e-3206a822eb01 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.231478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5096-c0b7-449b-af4e-3206a822eb01 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.232858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 350/680] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:20.233448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5096-c0b7-449b-af4e-3206a822eb01 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.284403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0917948-ce2a-4912-9e46-e464566f60e3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.324789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.326208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.326497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.326778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.327646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:20.327955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.329578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.342096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5096-c0b7-449b-af4e-3206a822eb01 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.348510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 331/681] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:20.349165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.385370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:20.385541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf7c55-c73d-4553-90f0-17d242c7e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.385940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7c55-c73d-4553-90f0-17d242c7e69a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.387075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7c55-c73d-4553-90f0-17d242c7e69a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.387355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf7c55-c73d-4553-90f0-17d242c7e69a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.395617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7c55-c73d-4553-90f0-17d242c7e69a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.398318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf7c55-c73d-4553-90f0-17d242c7e69a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.400861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-ffaf7c55-c73d-4553-90f0-17d242c7e69a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:20.412623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:20.413739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:20.414751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:20.416693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 351/682] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:20.417882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97c59-06c2-42d2-957a-31b89ca3c391 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.418166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97c59-06c2-42d2-957a-31b89ca3c391 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.418446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97c59-06c2-42d2-957a-31b89ca3c391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.436479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-13d97c59-06c2-42d2-957a-31b89ca3c391 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:20.437680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-13d97c59-06c2-42d2-957a-31b89ca3c391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:20.461520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4b393-968f-4dca-8051-357e87f81a3c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.504458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.505417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.505885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.506882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.507895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=c2d3a3a7c1f545e593e7956ec79f25ea) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:20.508006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 352/683] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:20.508505 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.508865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d97c59-06c2-42d2-957a-31b89ca3c391 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.510568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.527447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 332/684] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/role_assignments?user.id=c2d3a3a7c1f545e593e7956ec79f25ea&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:20.530360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.648671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:20.653592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f8ab0-a656-4187-a35e-aeb0617fccf6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.675299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d97c59-06c2-42d2-957a-31b89ca3c391 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.700688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947b13-3887-4837-a487-0954d22b19db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.701324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947b13-3887-4837-a487-0954d22b19db None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.701609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947b13-3887-4837-a487-0954d22b19db None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.701886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947b13-3887-4837-a487-0954d22b19db None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.702646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947b13-3887-4837-a487-0954d22b19db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:20.702957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947b13-3887-4837-a487-0954d22b19db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.704882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947b13-3887-4837-a487-0954d22b19db None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.718629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:20.720119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 333/685] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:20.721333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947b13-3887-4837-a487-0954d22b19db None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.738696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.742621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.742621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.742621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.827157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:20.828676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:20.856757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947b13-3887-4837-a487-0954d22b19db None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:20.907075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:20.908139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:20.908659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:20.909159 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:20.922828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:20.927791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:20.929291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 334/686] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:20.930147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.950290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:20.952515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 353/687] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:20.953502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:20.993330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:21.072860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f5a2c-6f45-4772-925f-03a2ac3a714c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.073196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd192adc-d2b3-442f-bf39-35cfd6b61fdf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.112338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.112959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.113237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.113511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:21.114297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=e90c842029d845bd8b4f12696354af78) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:21.114605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:21.116099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:21.116541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.117323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.117751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.118368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:21.119746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:21.120212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:21.121987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:21.127315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 335/688] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/role_assignments?user.id=e90c842029d845bd8b4f12696354af78&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:21.127315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:21.145211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 354/689] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:21.153579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:21.278058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:21.302003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1ac7-6fe8-47b7-a2c0-683830176232 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.343856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.345304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.346193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.346714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:21.362704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:21.364035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:21.366099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:21.375971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08be66-460a-4b44-9607-a888d6f11d60 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:21.387452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:21.388394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:21.389302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:21.389302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:21.389302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:21.389302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:21.391624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 336/690] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:21.400291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:21.427041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.427793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.428626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.428903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:21.442170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:21.443705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:21.460600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:21.461557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:21.462479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:21.462479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:21.462479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:21.462479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:21.462479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 355/691] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:21.472023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:21.537330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83945d56-1775-481f-8476-b81e0e1af4a5 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.575851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.577015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.577557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.578040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:21.578948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:21.579578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:21.581187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:21.582887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:21.596687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 337/692] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:21.602141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:21.622318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76759-c66a-46c7-b3d6-7a84f3790f51 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.720148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ec814-d9a4-434e-9450-37e85700425f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.723316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.723316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.723316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.723316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:21.723672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:21.723904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:21.725459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:21.765253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 356/693] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:21.770706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.771409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.771694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.772124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:21.772329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:21.780054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:21.781573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:21.782741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:21.799061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:21.800055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:21.800983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 338/694] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:21.809082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:21.891055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:21.941048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506f1d4-ef9a-49a9-8cc6-93afb9deb285 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.985352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f3583-f829-4837-86ca-066b478acc17 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:21.992928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:21.998009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:21.998524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:21.999053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.000032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:22.000550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.002184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.033756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 339/695] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:22.039996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:22.046953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:22.048755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.054947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.055523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.065958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.069902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:22.089912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:22.091408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:22.092377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:22.095627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 357/696] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:05:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:22.102095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:22.198382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:22.227642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7b6e-2498-46f5-b682-67c95a8b93e9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:22.242075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46346ff6-5231-4c9f-b0c4-3384dd3b3f22 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:22.248876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:22.278680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825a72-7687-40df-a004-c19d947b257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:22.279741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825a72-7687-40df-a004-c19d947b257b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.280397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825a72-7687-40df-a004-c19d947b257b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.280961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825a72-7687-40df-a004-c19d947b257b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.281482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:22.282109 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.282393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.282627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825a72-7687-40df-a004-c19d947b257b None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=11cd9091a4654f5eb689e23061b6e52e) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:22.282732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.283238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825a72-7687-40df-a004-c19d947b257b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.283483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:22.283797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.285257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.285533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825a72-7687-40df-a004-c19d947b257b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.293995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 340/697] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:22 2022] GET /identity/v3/role_assignments?user.id=11cd9091a4654f5eb689e23061b6e52e&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:22.296806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec68b-8fba-4ec7-8269-f9db137500ee None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.297339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec68b-8fba-4ec7-8269-f9db137500ee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.297818 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec68b-8fba-4ec7-8269-f9db137500ee None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.299750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 341/698] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:22.311386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67b98-fd3c-445e-aa06-a3e1ca4f82b7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.311386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67b98-fd3c-445e-aa06-a3e1ca4f82b7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.311386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67b98-fd3c-445e-aa06-a3e1ca4f82b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.314742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 358/699] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:05:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:22.320705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:22.351289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ecb67b98-fd3c-445e-aa06-a3e1ca4f82b7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:22.354656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ecb67b98-fd3c-445e-aa06-a3e1ca4f82b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:22.484594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 342/700] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:22.499046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202679-d249-4dbd-a3ce-e5fcf642d1d0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:22.517681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67b98-fd3c-445e-aa06-a3e1ca4f82b7 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:22.526582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:22.543536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:22.544211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.544497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.544774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.620924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.622472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.628699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67b98-fd3c-445e-aa06-a3e1ca4f82b7 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:22.640863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:22.670549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:22.671361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.671738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.672264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.672916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.675285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:22.687414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:22.688641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:22.689732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:22.691841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 343/701] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jul 27 04:05:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:22.699824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:22.758015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 359/702] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 04:05:22.763470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:22.796924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:22.834217 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a537bc-32c4-4171-8bde-a50355991786 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:22.869885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab6321-6a97-42df-8ab5-e44e6e4de24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:22.870509 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6321-6a97-42df-8ab5-e44e6e4de24f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.870790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6321-6a97-42df-8ab5-e44e6e4de24f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.871121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6321-6a97-42df-8ab5-e44e6e4de24f None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.871772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab6321-6a97-42df-8ab5-e44e6e4de24f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:22.872074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab6321-6a97-42df-8ab5-e44e6e4de24f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.873762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab6321-6a97-42df-8ab5-e44e6e4de24f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.879818 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 344/703] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 04:05:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:22.886135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf2483-999b-4744-bac5-487b62e3019a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.886135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf2483-999b-4744-bac5-487b62e3019a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.886135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf2483-999b-4744-bac5-487b62e3019a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.886135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 345/704] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:22.888812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf2483-999b-4744-bac5-487b62e3019a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:22.913315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e5366-281f-49c8-8938-8a917b68f3c2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:22.930895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:22.953970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15b8e9-a429-46c6-9946-6a2518d8fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:22.954615 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15b8e9-a429-46c6-9946-6a2518d8fe13 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.954894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15b8e9-a429-46c6-9946-6a2518d8fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.955170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15b8e9-a429-46c6-9946-6a2518d8fe13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:22.965835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15b8e9-a429-46c6-9946-6a2518d8fe13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:22.967293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15b8e9-a429-46c6-9946-6a2518d8fe13 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-5b15b8e9-a429-46c6-9946-6a2518d8fe13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:22.982657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:22.983798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:22.984872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:22.984872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:22.984872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:22.984872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:22.988757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 360/705] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:22.990096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6afd12-b01e-4ec9-b03d-ca4dec7eb9f3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:22.990380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6afd12-b01e-4ec9-b03d-ca4dec7eb9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:22.991248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6afd12-b01e-4ec9-b03d-ca4dec7eb9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.010678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ad6afd12-b01e-4ec9-b03d-ca4dec7eb9f3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:23.011905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ad6afd12-b01e-4ec9-b03d-ca4dec7eb9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:23.026521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf2483-999b-4744-bac5-487b62e3019a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:23.070192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:23.070816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.071098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.071426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.072216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:23.072511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:23.073898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:23.087420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 346/706] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 04:05:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:23.087420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:23.098200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 361/707] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:23.140704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6afd12-b01e-4ec9-b03d-ca4dec7eb9f3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:23.143246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:23.359601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5308a-64f0-4946-a505-1f8bb67d9db8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:23.360127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6afd12-b01e-4ec9-b03d-ca4dec7eb9f3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:23.363686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:23.408242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:23.410364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.410857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.411639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.429592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:23.430605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.431531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.432991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.433915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:23.435105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:23.436793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:23.437762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:23.439530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:23.469547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:23.470559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:23.471524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:23.471524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:23.471524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:23.471524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:23.472728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 347/708] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:23.474413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 362/709] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:23.481792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:23.487181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:23.553485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:23.602886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddb56d-288f-436c-aba8-4b97bb3dde02 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:23.649264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:23.649895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.650171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.650440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.651132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:23.651457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:23.652826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:23.682480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 363/710] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:23.684253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b050572-8fab-4945-b59e-707b18735542 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:23.691072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:23.733992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:23.735975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.736257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.736771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.749855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:23.751331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:23.776686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:23.777665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:23.778582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:23.783406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 348/711] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:23.793828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:23.826800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:23.873415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fda9e3-4360-41e4-b376-c41283917db7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:23.894011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:23.917588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99def9-47d5-435a-8e00-853569936874 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:23.917895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123135e1-762d-44ba-acfb-0beb6543c0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:23.918264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123135e1-762d-44ba-acfb-0beb6543c0db None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.918549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123135e1-762d-44ba-acfb-0beb6543c0db None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.918819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123135e1-762d-44ba-acfb-0beb6543c0db None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.919539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123135e1-762d-44ba-acfb-0beb6543c0db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:23.920965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123135e1-762d-44ba-acfb-0beb6543c0db None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:23.947097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 364/712] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:05:23 2022] POST /identity/v3/users => generated 254 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:23.948396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785125c-0c9c-44c3-a5de-8f3d6fa515b7 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.948744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785125c-0c9c-44c3-a5de-8f3d6fa515b7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.949073 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785125c-0c9c-44c3-a5de-8f3d6fa515b7 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.954922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 365/713] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:23.956799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410405bb-407e-4c49-b846-c5fa620b5060 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.957088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410405bb-407e-4c49-b846-c5fa620b5060 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.957359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410405bb-407e-4c49-b846-c5fa620b5060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.978876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:23.979539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:23.979825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:23.980104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:23.980860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:23.981170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:23.982526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-410405bb-407e-4c49-b846-c5fa620b5060 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:23.982713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:23.983890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-410405bb-407e-4c49-b846-c5fa620b5060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:24.011850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 349/714] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:24.017785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:24.065951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 366/715] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:24.093759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410405bb-407e-4c49-b846-c5fa620b5060 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:24.194681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:24.223582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:24.228219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410405bb-407e-4c49-b846-c5fa620b5060 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:24.242854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7840-230b-4c69-8b8b-6fff49f34272 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:24.272699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:24.273892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:24.274225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:24.274641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] PATH_INFO: `/v3/services/network` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:24.275487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:24.277130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:24.290529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:24.291157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:24.291481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:24.291933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:24.292115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:24.294840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:24.297511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:24.299199 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a61ebb13ad8c483fa715e5f6906b05f0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:24.299199 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:24.307725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 367/716] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:24 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:24.307923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:24.308087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:24.308246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 350/717] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:24 2022] GET /identity/v3/role_assignments?user.id=a61ebb13ad8c483fa715e5f6906b05f0&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:24.426657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e292-4fd2-46c8-93e4-29b6b6ada43e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:24.468808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666109-76cf-4578-b380-f32ce71b717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:24.469504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666109-76cf-4578-b380-f32ce71b717a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:24.469788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666109-76cf-4578-b380-f32ce71b717a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:24.470058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666109-76cf-4578-b380-f32ce71b717a None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:24.470762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666109-76cf-4578-b380-f32ce71b717a None admin] RBAC: Adding query filter params (name=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:24.471064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666109-76cf-4578-b380-f32ce71b717a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:24.472504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666109-76cf-4578-b380-f32ce71b717a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:24.479108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 368/718] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:24.486771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:24.606937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbef37c-49dc-458a-bedf-41cc789f43ff None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:24.642488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f6c50-fa8a-4a41-a886-68123a6be910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:24.643102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f6c50-fa8a-4a41-a886-68123a6be910 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:24.643437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f6c50-fa8a-4a41-a886-68123a6be910 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:24.643709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f6c50-fa8a-4a41-a886-68123a6be910 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:24.644378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f6c50-fa8a-4a41-a886-68123a6be910 None admin] RBAC: Adding query filter params (type=network) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:24.644677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f6c50-fa8a-4a41-a886-68123a6be910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:24.646030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f6c50-fa8a-4a41-a886-68123a6be910 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:24.660139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 351/719] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:24.811171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d499-8a68-4900-ba8f-3b9561e33fd0 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:24.811171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d499-8a68-4900-ba8f-3b9561e33fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:24.811171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d499-8a68-4900-ba8f-3b9561e33fd0 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:24.811171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 369/720] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:24.817627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69f23-3473-46e6-b947-2fcc71c2d47c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:24.817935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69f23-3473-46e6-b947-2fcc71c2d47c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:24.818175 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d69f23-3473-46e6-b947-2fcc71c2d47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:24.849026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-42d69f23-3473-46e6-b947-2fcc71c2d47c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:24.850791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-42d69f23-3473-46e6-b947-2fcc71c2d47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:24.853078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:24.949774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 352/721] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:24.978528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d499-8a68-4900-ba8f-3b9561e33fd0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:25.012339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:25.104897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d499-8a68-4900-ba8f-3b9561e33fd0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:25.153341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:25.153986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:25.154270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:25.154540 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:25.169562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:25.174902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:25.175920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:25.176807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 370/722] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:25.182408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d69f23-3473-46e6-b947-2fcc71c2d47c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:25.291768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d69f23-3473-46e6-b947-2fcc71c2d47c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:25.331984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6059f54-90ce-44c5-aef7-6a996f6c86f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:25.332610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059f54-90ce-44c5-aef7-6a996f6c86f3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:25.332890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059f54-90ce-44c5-aef7-6a996f6c86f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:25.333164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059f54-90ce-44c5-aef7-6a996f6c86f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:25.333876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6059f54-90ce-44c5-aef7-6a996f6c86f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:25.334718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6059f54-90ce-44c5-aef7-6a996f6c86f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:25.336239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6059f54-90ce-44c5-aef7-6a996f6c86f3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:25.347600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:25.352309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 353/723] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:25.357924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:25.380254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a408a5-81cd-4826-8e41-093ef34acbf6 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:25.380600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a408a5-81cd-4826-8e41-093ef34acbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:25.380802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a408a5-81cd-4826-8e41-093ef34acbf6 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:25.382478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 354/724] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:25.391499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a01718-f7c5-4bf5-b7eb-d035b09b352d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:25.391775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a01718-f7c5-4bf5-b7eb-d035b09b352d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:25.392055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a01718-f7c5-4bf5-b7eb-d035b09b352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:25.410820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-15a01718-f7c5-4bf5-b7eb-d035b09b352d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:25.412025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-15a01718-f7c5-4bf5-b7eb-d035b09b352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:25.506413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:25.517324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 355/725] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 04:05:25.524727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10136bb2-bfa4-46bb-8925-5b6afa584510 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:25.564166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:25.564731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:25.565012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:25.565289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:25.568299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a01718-f7c5-4bf5-b7eb-d035b09b352d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:25.578001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:25.579544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:25.595806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:25.596838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:25.598401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:25.598401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:25.598401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:25.598401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:25.598401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 371/726] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:25.602734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:25.712023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a01718-f7c5-4bf5-b7eb-d035b09b352d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:25.768401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:25.780096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:25.780723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:25.781002 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:25.781272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:25.781969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:25.783362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:25.800754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5c191-e546-40b8-8323-255625b34663 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:25.816797 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 356/727] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:25 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:25.882297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:25.882897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:25.883175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:25.883479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:25.884182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:25.884734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:25.886144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:25.892663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:25.909211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 372/728] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:25.915947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:26.040775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471903b-4093-4c85-bb23-8d44fe541a01 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:26.075158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:26.075761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:26.076352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:26.076634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:26.085510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:26.086949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:26.098260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:26.099208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:26.101270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 357/729] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:26.105495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:26.211480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dcde6-1d08-4657-abe7-62a6269404d2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:26.264260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:26.264887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:26.265173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:26.265450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:26.266244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:26.266553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:26.268027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:26.296244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 373/730] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 04:05:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:26.301751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:26.372660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:26.443129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148b30-5eb7-437d-a4e8-c7b2a584bbcf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:26.494985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d62c3-2b45-4cdd-b640-23a3bd6a7079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:26.495642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d62c3-2b45-4cdd-b640-23a3bd6a7079 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:26.495923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d62c3-2b45-4cdd-b640-23a3bd6a7079 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:26.496200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d62c3-2b45-4cdd-b640-23a3bd6a7079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:26.567756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d62c3-2b45-4cdd-b640-23a3bd6a7079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:26.570000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d62c3-2b45-4cdd-b640-23a3bd6a7079 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:26.619320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:26.671686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 358/731] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:26 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 04:05:26.680572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:26.758480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:26.801104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad19f5-bb86-4c6a-b7b8-c9d11839843c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:26.801436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad19f5-bb86-4c6a-b7b8-c9d11839843c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:26.801659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad19f5-bb86-4c6a-b7b8-c9d11839843c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:26.804107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 359/732] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:26.815707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582107ac-dd94-4831-a349-98a0f7aff6a5 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:26.821101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139dece-bd9d-4d02-9158-3c92dbd71546 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:26.821601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139dece-bd9d-4d02-9158-3c92dbd71546 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:26.822027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139dece-bd9d-4d02-9158-3c92dbd71546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:26.855300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:26.855300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:26.855300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:26.855300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:26.856729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9139dece-bd9d-4d02-9158-3c92dbd71546 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:26.858105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9139dece-bd9d-4d02-9158-3c92dbd71546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:26.865078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:26.867430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:26.884160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:26.885587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:26.886648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:26.886648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:26.886648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:26.886648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:26.888693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 374/733] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:26.894226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.003654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af82-8ca8-4ce8-868c-61bf269ef204 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.011920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:27.043686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.044586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.045016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.045436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.046271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:27.046806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:27.048355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:27.053931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 360/734] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:27.062208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 375/735] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:27.067834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139dece-bd9d-4d02-9158-3c92dbd71546 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.079020 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.184361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd6167-f894-4a1c-85d9-06607e75b0df None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.198003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:27.220850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0b1f-22c8-4589-b5f6-a77703295606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.221499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0b1f-22c8-4589-b5f6-a77703295606 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.221781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0b1f-22c8-4589-b5f6-a77703295606 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.222012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139dece-bd9d-4d02-9158-3c92dbd71546 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.222135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0b1f-22c8-4589-b5f6-a77703295606 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.233426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0b1f-22c8-4589-b5f6-a77703295606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-557e0b1f-22c8-4589-b5f6-a77703295606 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:27.238337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:27.239533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:27.240767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 376/736] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:27.241634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad498a3c-f425-413a-8d5e-4ca03e018651 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.241634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad498a3c-f425-413a-8d5e-4ca03e018651 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.241909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad498a3c-f425-413a-8d5e-4ca03e018651 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.243154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 377/737] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:27.248945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad498a3c-f425-413a-8d5e-4ca03e018651 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.269883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49986-9336-4b8c-871b-63a6ff78edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.271173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49986-9336-4b8c-871b-63a6ff78edf4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.271694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49986-9336-4b8c-871b-63a6ff78edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.272302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49986-9336-4b8c-871b-63a6ff78edf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.279736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:27.283013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49986-9336-4b8c-871b-63a6ff78edf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:27.285881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49986-9336-4b8c-871b-63a6ff78edf4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-30d49986-9336-4b8c-871b-63a6ff78edf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:27.301100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:27.302245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:27.303449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:27.306050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 361/738] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:27.307480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db567f25-3009-4e51-8b82-365a04bbb79f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.307902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db567f25-3009-4e51-8b82-365a04bbb79f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.308326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db567f25-3009-4e51-8b82-365a04bbb79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.335242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-db567f25-3009-4e51-8b82-365a04bbb79f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:27.336573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-db567f25-3009-4e51-8b82-365a04bbb79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:27.373671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad498a3c-f425-413a-8d5e-4ca03e018651 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.411356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.412125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.412530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.412909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.413733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:27.414163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:27.415335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 362/739] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:27.415842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:27.416267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db567f25-3009-4e51-8b82-365a04bbb79f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.425384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 378/740] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:27.432971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.508344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:27.534430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:27.542920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db567f25-3009-4e51-8b82-365a04bbb79f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.547548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c3ae-a217-40b9-9524-78fb12ab0ce8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.582480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854be8f8-ce42-4173-851e-d91d91cbab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.583141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be8f8-ce42-4173-851e-d91d91cbab53 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.583449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be8f8-ce42-4173-851e-d91d91cbab53 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.583726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be8f8-ce42-4173-851e-d91d91cbab53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.586054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.586867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.586989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.587223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.588016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:27.588326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:27.589763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:27.595492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854be8f8-ce42-4173-851e-d91d91cbab53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:27.597402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854be8f8-ce42-4173-851e-d91d91cbab53 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:27.606632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 363/741] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:27.606632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-854be8f8-ce42-4173-851e-d91d91cbab53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:27.612269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:27.613192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:27.614101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:27.614101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:27.614101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:27.614101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:27.618737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 379/742] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:27.619999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bd90-0043-486a-9849-06c4d3fc146b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.620288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bd90-0043-486a-9849-06c4d3fc146b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.620573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bd90-0043-486a-9849-06c4d3fc146b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.621841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 380/743] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:27.622531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6bd90-0043-486a-9849-06c4d3fc146b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.716706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a4cec-0605-4f49-9e4a-3d0b37f7e64d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.728797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6bd90-0043-486a-9849-06c4d3fc146b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.752285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:27.759011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e065c90-40f4-4bdd-a346-1d112623ee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.759948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e065c90-40f4-4bdd-a346-1d112623ee17 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.760230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e065c90-40f4-4bdd-a346-1d112623ee17 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.760502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e065c90-40f4-4bdd-a346-1d112623ee17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.767104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.767765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.768048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.768338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.769117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=11cd9091a4654f5eb689e23061b6e52e) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:27.769432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:27.770899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:27.773174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e065c90-40f4-4bdd-a346-1d112623ee17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:27.783962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 381/744] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/role_assignments?user.id=11cd9091a4654f5eb689e23061b6e52e&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:27.783962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5e065c90-40f4-4bdd-a346-1d112623ee17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:27.784270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:27.785237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 364/745] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:27.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655f78-7d5e-4546-8520-fc3b18d71dfe None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.786916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655f78-7d5e-4546-8520-fc3b18d71dfe None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.786916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655f78-7d5e-4546-8520-fc3b18d71dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.796953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:27.817639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a4655f78-7d5e-4546-8520-fc3b18d71dfe None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:27.819700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a4655f78-7d5e-4546-8520-fc3b18d71dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:27.914200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66f3f-bbd1-4994-bcd8-d1d0602f6f8d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:27.919451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 365/746] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 04:05:27.920644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4655f78-7d5e-4546-8520-fc3b18d71dfe None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:27.974447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:27.975141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:27.975947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:27.976235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:27.977410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:27.977725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:27.979781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:27.997393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 382/747] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:27.998242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:28.056160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4655f78-7d5e-4546-8520-fc3b18d71dfe None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:28.084062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:28.092620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:28.111042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:28.112072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.112503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.113295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.114653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:28.115113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:28.117597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:28.135112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 366/748] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:28.135112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:28.142002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d36453-7b11-4e6f-9c1e-d9d7547a0462 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:28.185044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:28.185671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.185948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.186221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.187372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:28.189341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:28.215380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 383/749] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:27 2022] POST /identity/v3/services => generated 240 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:28.216722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:28.294179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6702051-06e8-4125-913e-214bfbb2b355 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:28.378842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed7b30-f633-4ae2-9620-7242318e9ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:28.379437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed7b30-f633-4ae2-9620-7242318e9ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.379719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed7b30-f633-4ae2-9620-7242318e9ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.379994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed7b30-f633-4ae2-9620-7242318e9ae5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.389462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed7b30-f633-4ae2-9620-7242318e9ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:28.390919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed7b30-f633-4ae2-9620-7242318e9ae5 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-44ed7b30-f633-4ae2-9620-7242318e9ae5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:28.402947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:28.404011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:28.404974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 367/750] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:05:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:28.406094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6fc6-54c3-4166-8116-a37ba0248965 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.406094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6fc6-54c3-4166-8116-a37ba0248965 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.406260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6fc6-54c3-4166-8116-a37ba0248965 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.411561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 368/751] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:28.412482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af6fc6-54c3-4166-8116-a37ba0248965 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:28.418167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012696a-5781-4b3c-81ba-b04985628d66 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:28.452819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:28.468819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:28.473309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:28.474307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.475664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.476158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.545470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af6fc6-54c3-4166-8116-a37ba0248965 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:28.586600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd988a74-cf73-4f16-801e-c55f6070bde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:28.588033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988a74-cf73-4f16-801e-c55f6070bde6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.588565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988a74-cf73-4f16-801e-c55f6070bde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.589014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988a74-cf73-4f16-801e-c55f6070bde6 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.590007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd988a74-cf73-4f16-801e-c55f6070bde6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:28.590523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd988a74-cf73-4f16-801e-c55f6070bde6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:28.592171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd988a74-cf73-4f16-801e-c55f6070bde6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:28.609105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:28.610677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:28.612601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 369/752] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 04:05:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:28.614095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee09577-dd77-4b28-94ee-75f11bcf4150 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.614601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee09577-dd77-4b28-94ee-75f11bcf4150 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.615071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee09577-dd77-4b28-94ee-75f11bcf4150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:28.626662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:28.627646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:28.628575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:28.628575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:28.628575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:28.628575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:28.628575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 384/753] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:28.629349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:28.637170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bee09577-dd77-4b28-94ee-75f11bcf4150 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:28.638689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bee09577-dd77-4b28-94ee-75f11bcf4150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:28.710160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 370/754] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:28.711921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee09577-dd77-4b28-94ee-75f11bcf4150 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:28.768264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd174507-fd39-4b4c-a3a5-ceca65d66fad None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:28.769284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:28.809023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:28.810127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.810946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.811424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.855782 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee09577-dd77-4b28-94ee-75f11bcf4150 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:28.867742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:28.890943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:28.893071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:28.900335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:28.901226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:28.901684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:28.902129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:28.902990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:28.903892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:28.905773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:28.923376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 371/755] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:28.924386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.020852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 385/756] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:05:29.022660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.033954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.059085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37ab70-f533-4cca-928f-37042312d562 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.106070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.107010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.107317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.107598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.108234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.110531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.117969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:29.122027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:29.123399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:29.124406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 372/757] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jul 27 04:05:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:29.125300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.150410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b54b2-6c5f-4860-9c1c-ebbabb261adf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.194005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.194675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.195091 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.195372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.202949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.204533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:29.216854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:29.218105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:29.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:29.222612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 386/758] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:29.223554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.244197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd18e-c181-440b-9b31-cde07e6d3d72 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.280803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.281662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.282132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.282643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.295074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.296730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:29.312267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:29.313402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:29.314358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:29.314358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:29.314358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:29.314358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:29.316135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 373/759] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:29.317189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.321856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.337567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a426b-7772-4375-9256-4ee623fab441 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.375981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.376874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.377304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.377723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.378647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:29.379148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.381167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.383485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.387536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 387/760] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:29.388486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.430408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f06ae0-2263-4f5f-bd59-c630b62def02 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.468717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.469635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.470062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.470575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.471660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:29.472116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.473727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.494812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 374/761] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:29.496652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.516098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c81ed7-21ab-44e0-b4c0-c21b4929fefe None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.554459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.555051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.555362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.555640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.556330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:29.556633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.558116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.568450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.576902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 388/762] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:29.577833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.612288 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31227b81-e95e-4478-98ec-3bd78ce330ed None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.641505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.651345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.652158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.652581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.652992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.653899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:29.654418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.656083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.661762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 375/763] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:29.663048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.686115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcd2f8-89e0-4ef7-8a71-cc790dde9920 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.724101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.725396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.725809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.726184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.737472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.739394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:29.757951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:29.759079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:29.760344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:29.760344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:29.760344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:29.760344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:29.764203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 389/764] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:29.765074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.770026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3eacb-536e-40f1-a0af-f731664f4b5c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.798843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.810965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.811400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.811687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.811963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.820084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.821628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:29.833943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:29.835877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:29.836935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:29.840978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 376/765] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:29.841834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.880823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6c91-409d-48d4-ab42-9587f966f87f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.896030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:29.920207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.921081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.921363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.921741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.922506 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] RBAC: Adding query filter params (interface=public, service_id=02960060a1fb4dabb18a70f97a914ccc, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:29.922820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.924227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:29.932520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 390/766] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/endpoints?service_id=02960060a1fb4dabb18a70f97a914ccc&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:29.933773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:29.955968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cf7e-295e-434e-99c3-43ce7da7133d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:29.991968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19be7b-22d8-4618-b268-a1668062a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:29.992588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19be7b-22d8-4618-b268-a1668062a788 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:29.992928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19be7b-22d8-4618-b268-a1668062a788 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:29.993203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19be7b-22d8-4618-b268-a1668062a788 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:29.993894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19be7b-22d8-4618-b268-a1668062a788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:29.994195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19be7b-22d8-4618-b268-a1668062a788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:29.995574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19be7b-22d8-4618-b268-a1668062a788 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.008528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 377/767] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:30.010113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be35b-a463-48b9-bca5-a38a2c464b6b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.010405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be35b-a463-48b9-bca5-a38a2c464b6b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.010680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be35b-a463-48b9-bca5-a38a2c464b6b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.012051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 378/768] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:30.016884 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be35b-a463-48b9-bca5-a38a2c464b6b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.051550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876e3a-b4d8-434d-8e6a-4ef71897e42f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.069343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:30.092572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.093199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.093483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.093765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.094509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:30.094818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.096887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.108881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 391/769] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:30.109688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.133539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3be35b-a463-48b9-bca5-a38a2c464b6b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.147820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:30.169350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b06434-3859-4209-938a-e167aab5308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.169962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b06434-3859-4209-938a-e167aab5308c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.170243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b06434-3859-4209-938a-e167aab5308c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.170517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b06434-3859-4209-938a-e167aab5308c None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.171169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b06434-3859-4209-938a-e167aab5308c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.172568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b06434-3859-4209-938a-e167aab5308c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.178141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 379/770] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:30.179230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe5c1-2491-43d9-b7d6-40828350c323 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.179555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe5c1-2491-43d9-b7d6-40828350c323 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.179824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe5c1-2491-43d9-b7d6-40828350c323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.199950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a9ffe5c1-2491-43d9-b7d6-40828350c323 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:30.201244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a9ffe5c1-2491-43d9-b7d6-40828350c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:30.242996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6a7f2-1da2-4f60-a943-10a38dc36db8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.283300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 380/771] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:30.283300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe5c1-2491-43d9-b7d6-40828350c323 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.297120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.298294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.298789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.299351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.316999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.319609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.327534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:30.339854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:30.340841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 392/772] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:30.343004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.404433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe5c1-2491-43d9-b7d6-40828350c323 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.440751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.441394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.441647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.441920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.442710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a3d53b503346487fa4d707623ab4cec2) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:30.443025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.445394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.451544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 381/773] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/role_assignments?user.id=a3d53b503346487fa4d707623ab4cec2&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:30.452348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.460101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:30.470585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81bd4e-1902-42a1-9417-9fc8756e6b85 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.512618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61056f-45eb-46c9-a56f-f024e0decc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.513300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61056f-45eb-46c9-a56f-f024e0decc1b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.513646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61056f-45eb-46c9-a56f-f024e0decc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.513991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61056f-45eb-46c9-a56f-f024e0decc1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.529432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61056f-45eb-46c9-a56f-f024e0decc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0b61056f-45eb-46c9-a56f-f024e0decc1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:30.534896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:30.535972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:30.536843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 393/774] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:30.540227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6ac12-ee60-433c-8137-05d6c68d650c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.540438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6ac12-ee60-433c-8137-05d6c68d650c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.540835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6ac12-ee60-433c-8137-05d6c68d650c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.542900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 394/775] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:30.544006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6ac12-ee60-433c-8137-05d6c68d650c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.605631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a3590-0497-4859-8c53-4d1c705c4430 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.607502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:30.646236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e0e1-4423-4ac1-8408-4cc3a345c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.647558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e0e1-4423-4ac1-8408-4cc3a345c3cd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.647756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e0e1-4423-4ac1-8408-4cc3a345c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.647979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e0e1-4423-4ac1-8408-4cc3a345c3cd None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.648728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e0e1-4423-4ac1-8408-4cc3a345c3cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:30.649038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e0e1-4423-4ac1-8408-4cc3a345c3cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.650486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e0e1-4423-4ac1-8408-4cc3a345c3cd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.668774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 382/776] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:30.670135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aff27-5c97-4875-b354-89db08dbda13 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.670424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aff27-5c97-4875-b354-89db08dbda13 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.670698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aff27-5c97-4875-b354-89db08dbda13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.685544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6ac12-ee60-433c-8137-05d6c68d650c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.688662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-eb1aff27-5c97-4875-b354-89db08dbda13 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:30.689850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-eb1aff27-5c97-4875-b354-89db08dbda13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:30.735070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.736927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.737361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.737808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.738670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:30.739122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.741466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.753570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 395/777] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:30.754637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.783285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:30.783595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 383/778] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:30.784670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aff27-5c97-4875-b354-89db08dbda13 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.878521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae5c4d-5f47-4c3f-b127-e77e4f331025 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.901188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:30.911582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aff27-5c97-4875-b354-89db08dbda13 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:30.916957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.918235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.918701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.919180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a61ebb13ad8c483fa715e5f6906b05f0/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.921609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=a61ebb13ad8c483fa715e5f6906b05f0, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.923256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:30.944009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 396/779] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:30 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a61ebb13ad8c483fa715e5f6906b05f0/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:05:30.945618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:30.954115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:30.954860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:30.955211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:30.955579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:30.967513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:30.968842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:31.004163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:31.005241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:31.006234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:31.006234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:31.006234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:31.006234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:31.006234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 384/780] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:31.011805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:31.052040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:31.078496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e16f0-2c53-4ec4-a4f6-4d09b59f9539 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.116406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:31.117657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:31.118173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:31.118672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] PATH_INFO: `/v3/services/network` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:31.119564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:31.121190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:31.139587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:31.140717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:31.141588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:31.145254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 397/781] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:30 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:31.155545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:31.231771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452613f5-847b-425b-959e-0a56016d0672 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.268949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:31.269584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:31.269870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:31.270146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:31.270840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:31.271146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:31.273107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.273756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c090962-1f3d-4352-91fe-7b8517501a04 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.286137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 385/782] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:31.296273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:31.300356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:31.311288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:31.312162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:31.312589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:31.313054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:31.313900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] RBAC: Adding query filter params (name=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:31.314362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:31.315970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.321264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 398/783] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:31.327906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:31.339599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:31.470194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73b7e1-cac6-4352-b67a-777b7cadec41 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.502212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399414-6b9c-477a-904f-266949b7f623 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.511631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:31.512607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:31.513172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:31.513653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:31.522257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:31.524435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:31.539983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:31.541000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:31.541999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:31.549044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 386/784] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:31.550486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:31.608154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:31.608722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:31.609006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:31.609285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:31.609992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] RBAC: Adding query filter params (type=network) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:31.610306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:31.611773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.632747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:31.637645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 399/785] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:31.644194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:31.668149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c63808-5f57-4828-bcd0-2ca6bc98edeb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.705505 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:31.706134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:31.706844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:31.707137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:31.707971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:31.708286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:31.709874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.731643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 387/786] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 04:05:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:31.742760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:31.834800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:31.894996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3160a-15f7-40de-a1ea-c7bef4f9fe51 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.948941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9289a6-8a5c-4310-bc04-9ac4935fc09f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:31.970609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:31.971983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:31.972475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:31.972973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:31.974000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] RBAC: Adding query filter params (interface=public, service_id=2e053e5ec8ee4fb682c8c4e415c48f55, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:31.974656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:31.977035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:31.995627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 400/787] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:05:31 2022] GET /identity/v3/endpoints?service_id=2e053e5ec8ee4fb682c8c4e415c48f55&interface=public®ion_id=RegionOne => generated 194 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:32.003865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:32.006482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:32.023719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:32.025771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.026058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.026333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.047404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:32.048859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:32.081414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:32.082411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:32.083358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:32.083358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:32.083358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:32.083358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:32.084748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 388/788] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:32.091153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:32.208464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527649-0d82-458b-92f3-3379a659a7dc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:32.250824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:32.252626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.252908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.253183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.253876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:32.254181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:32.255566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:32.261030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87666-44b8-478b-ab84-b3af37ef259a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:32.282428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 389/789] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:32.287861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:32.323958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffbd0a-f99b-4c0c-9746-c07da5c1c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:32.324584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffbd0a-f99b-4c0c-9746-c07da5c1c414 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.324879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffbd0a-f99b-4c0c-9746-c07da5c1c414 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.325188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffbd0a-f99b-4c0c-9746-c07da5c1c414 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.325843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffbd0a-f99b-4c0c-9746-c07da5c1c414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:32.327447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffbd0a-f99b-4c0c-9746-c07da5c1c414 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:32.337847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 401/790] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:05:32 2022] GET /identity/v3/services => generated 772 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:32.339594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:32.344182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:32.446960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978338-f191-4ba4-91bb-7eeb858bd1c1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.447684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978338-f191-4ba4-91bb-7eeb858bd1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.448169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978338-f191-4ba4-91bb-7eeb858bd1c1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.450099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 402/791] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:32.456454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6312-f056-4436-8af6-ac867f717b42 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.457067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6312-f056-4436-8af6-ac867f717b42 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.457603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6312-f056-4436-8af6-ac867f717b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.469601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dd040-745c-4e74-81ba-cb3b398511ae None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:32.478555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-25dc6312-f056-4436-8af6-ac867f717b42 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:32.480176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-25dc6312-f056-4436-8af6-ac867f717b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:32.538581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:32.539180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.539489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.539762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.555743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:32.559053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:32.574272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:32.575292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:32.576240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:32.578896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 390/792] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:32.586521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:32.598073 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 403/793] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:32.616200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569c18-73d8-41ae-8ca9-5d5a8bc36947 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.616821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569c18-73d8-41ae-8ca9-5d5a8bc36947 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.617298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569c18-73d8-41ae-8ca9-5d5a8bc36947 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.619283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 404/794] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:32.621268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569c18-73d8-41ae-8ca9-5d5a8bc36947 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:32.716456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:32.729272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebdcf-59ca-4902-9832-a65ab1f2e31f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:32.769117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569c18-73d8-41ae-8ca9-5d5a8bc36947 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:32.775409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde59f5b-9c8a-421f-a60c-447200f083e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:32.776036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde59f5b-9c8a-421f-a60c-447200f083e4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.776314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde59f5b-9c8a-421f-a60c-447200f083e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.776584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde59f5b-9c8a-421f-a60c-447200f083e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.777328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde59f5b-9c8a-421f-a60c-447200f083e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:32.777631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde59f5b-9c8a-421f-a60c-447200f083e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:32.779048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde59f5b-9c8a-421f-a60c-447200f083e4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:32.795360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 391/795] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:32.795360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282c1c-048b-42ff-a319-1328cfbcd66c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.795360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282c1c-048b-42ff-a319-1328cfbcd66c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.795360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282c1c-048b-42ff-a319-1328cfbcd66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.809121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:32.814272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b6282c1c-048b-42ff-a319-1328cfbcd66c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:32.815498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b6282c1c-048b-42ff-a319-1328cfbcd66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:32.823950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:32.825458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:32.825986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:32.826938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:32.828239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:32.830220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:32.843628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:32.844603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 04:05:32.845479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:32.851496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 405/796] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jul 27 04:05:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:32.851496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:32.894532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 392/797] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:32.895639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282c1c-048b-42ff-a319-1328cfbcd66c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:32.973859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d56-10b1-456e-9d06-2575493e7f40 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:32.985978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:33.004153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282c1c-048b-42ff-a319-1328cfbcd66c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:33.013941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.014667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.014948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.015287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/11cd9091a4654f5eb689e23061b6e52e/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.017545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=11cd9091a4654f5eb689e23061b6e52e, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:33.018951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:33.034699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 406/798] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:32 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/11cd9091a4654f5eb689e23061b6e52e/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:05:33.035774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.043838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.044972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.045455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.045952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.046889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:33.047420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:33.049067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:33.056022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 393/799] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 04:05:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:33.061750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.106386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:33.169469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3cc06-7aa4-4fd4-a366-aea5ab08fa0b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:33.211784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.212864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.213359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.214145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.228223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:33.234988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:33.236027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:33.236885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:33.240896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 407/800] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:33.246247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.289405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534501e1-8565-4afa-a380-14f1c5445772 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:33.374225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332fd9d-aa7b-4a12-bbff-ef8733f27864 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:33.379988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.380632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.380944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.381219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.381904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:33.382210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:33.383746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:33.389566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:33.398631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 394/801] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 04:05:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:33.404282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.420806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.421656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.422261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.422678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.423560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:33.426183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:33.427788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:33.436859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:33.443079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 408/802] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:33.449767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.576478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56eaa1-551b-47df-9e94-95dbd94fdcde None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:33.577187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35485b9-31b0-4802-93cc-11ecd4431e60 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:33.612019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e44fde-3d74-43a5-b88c-c98ec2b2481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.612650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44fde-3d74-43a5-b88c-c98ec2b2481b None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.613128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44fde-3d74-43a5-b88c-c98ec2b2481b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.613246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44fde-3d74-43a5-b88c-c98ec2b2481b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.613908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e44fde-3d74-43a5-b88c-c98ec2b2481b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:33.615830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e44fde-3d74-43a5-b88c-c98ec2b2481b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:33.626270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.627699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.628291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.628878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.642279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:33.643770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:33.644481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 395/803] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:05:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:05:33.646241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67227172-15c2-484b-be8f-2a6984c524e3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.646943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67227172-15c2-484b-be8f-2a6984c524e3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.647398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67227172-15c2-484b-be8f-2a6984c524e3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.653548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 396/804] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:33.655426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df77d8-3b14-48ba-bb4a-ab682555bf6f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.655871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df77d8-3b14-48ba-bb4a-ab682555bf6f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.656294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df77d8-3b14-48ba-bb4a-ab682555bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:33.660061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:33.661158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:33.662495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:33.662495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:33.662495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:33.662495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:33.662495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 409/805] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:33.669593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.700258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d1df77d8-3b14-48ba-bb4a-ab682555bf6f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:33.702090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d1df77d8-3b14-48ba-bb4a-ab682555bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:33.738344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:33.827160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:33.838368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 397/806] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:33.863151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df77d8-3b14-48ba-bb4a-ab682555bf6f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.868001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35722d-316e-47e5-a4a0-f811f7bb5b9a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:33.908308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:33.909189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:33.909581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:33.909965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:33.910773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:33.911329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:33.913577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:33.926853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 410/807] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:33.933313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:33.975545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df77d8-3b14-48ba-bb4a-ab682555bf6f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.011325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.011945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.012282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.012570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.023599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:34.028470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:34.029415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:34.030717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 398/808] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:34.035591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:34.039528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:34.057298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d953c9-a39b-4ea1-90cd-52f03df75491 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.093826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:34.131982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.132699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.132993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.133345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.140345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad044af-0ef1-435f-91bf-601089efb43d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.156497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:34.157975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:34.176177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.176807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.177091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.177364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.178134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:34.178544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:34.180251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:34.186677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:34.187639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:34.188607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:34.194835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 411/809] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:05:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:34.196353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:34.203559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 399/810] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:34.206877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:34.400780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29e2b6-5c78-4a8f-a498-77fa40754ee9 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.411711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213972-60d0-4af6-a9c8-af8c506dbeb7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.441938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:34.469378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.470381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.470810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.471669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.474926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.475766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.476442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.477675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.482935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:34.483511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:34.485129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:34.496296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:34.498074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:34.515314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 412/811] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:34.522469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:34.523667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:34.524733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:34.524733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:34.524733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:34.524733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:34.525911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:34.530096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 400/812] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:34.532191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:34.533115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:34.669416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df408d0e-fb14-4f52-9300-c1002241967f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.676470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921fc94-0d0c-428d-9455-ec5e39e431ed None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.712085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.712715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.713001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.713279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.713974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:34.714280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:34.715735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:34.730280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 401/813] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:34.735606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:34.765914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:34.807994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.808661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.808944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.809220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.843629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2dae5-9738-40fb-8cb6-c505c9d91074 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:34.844148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:34.845563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:34.879398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:34.880102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:34.880418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:34.881514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:34.889433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:34.891039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:34.897047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:34.897954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:34.899434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:34.899434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:34.899434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:34.899434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:34.899434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 413/814] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:34.908604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:34.909608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:05:34.911762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:34.913388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:34.913565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 402/815] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:34.919295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.015349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.016057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.033284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7fee-2855-428c-92f5-2283e090da31 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.066458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9d597-b387-492d-8ea1-de1f846cd612 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.075452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f523d-ea73-4053-8df8-4803b014b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.076083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f523d-ea73-4053-8df8-4803b014b277 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.076360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f523d-ea73-4053-8df8-4803b014b277 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.076633 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f523d-ea73-4053-8df8-4803b014b277 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.077847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f523d-ea73-4053-8df8-4803b014b277 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:35.078157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f523d-ea73-4053-8df8-4803b014b277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.080283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f523d-ea73-4053-8df8-4803b014b277 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.105126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 403/816] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:35.106807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb81aca-1c7c-4402-9fb4-2db84e5efa8a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.107195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb81aca-1c7c-4402-9fb4-2db84e5efa8a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.107641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb81aca-1c7c-4402-9fb4-2db84e5efa8a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.108602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c3f4-744e-4e4a-8d1f-9e7af96b54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.109277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 404/817] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:35.109396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c3f4-744e-4e4a-8d1f-9e7af96b54e7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.109983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb81aca-1c7c-4402-9fb4-2db84e5efa8a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.113738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c3f4-744e-4e4a-8d1f-9e7af96b54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.114132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c3f4-744e-4e4a-8d1f-9e7af96b54e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.116486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c3f4-744e-4e4a-8d1f-9e7af96b54e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:35.116880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c3f4-744e-4e4a-8d1f-9e7af96b54e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.118374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c3f4-744e-4e4a-8d1f-9e7af96b54e7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.136300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 414/818] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:35.137827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9259a0-fce4-4636-8439-12446fa3bdeb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.138199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9259a0-fce4-4636-8439-12446fa3bdeb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.138552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9259a0-fce4-4636-8439-12446fa3bdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.164438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-db9259a0-fce4-4636-8439-12446fa3bdeb None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:35.166364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-db9259a0-fce4-4636-8439-12446fa3bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:35.229464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb81aca-1c7c-4402-9fb4-2db84e5efa8a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.259805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 415/819] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:35.260696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9259a0-fce4-4636-8439-12446fa3bdeb None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.269515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4276893-e7aa-4411-88d6-7915a247598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.270147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4276893-e7aa-4411-88d6-7915a247598d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.270429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4276893-e7aa-4411-88d6-7915a247598d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.270706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4276893-e7aa-4411-88d6-7915a247598d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.295934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.337580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.360357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4276893-e7aa-4411-88d6-7915a247598d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.362116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4276893-e7aa-4411-88d6-7915a247598d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.395814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9259a0-fce4-4636-8439-12446fa3bdeb None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.431367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.432009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.432638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.432638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.439313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.440771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:35.454456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:35.455425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 416/820] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:35.456425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.473269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 405/821] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:05:35.479563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef138b-3aca-4664-9d53-c072c9373fe4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.479858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef138b-3aca-4664-9d53-c072c9373fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.480143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef138b-3aca-4664-9d53-c072c9373fe4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.481458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 406/822] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:35.485636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef138b-3aca-4664-9d53-c072c9373fe4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.534006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.568094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741531-8d1c-4be3-a0a2-d0d1c63499a8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.576140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.596385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef138b-3aca-4664-9d53-c072c9373fe4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.606330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.606984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.607291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.607896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.608628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.609922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:35.619851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:35.620879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:35.621736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 417/823] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:35.622564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.638326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884b54f-1772-46ea-9f76-67e858a6517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.639769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b54f-1772-46ea-9f76-67e858a6517f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.640243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b54f-1772-46ea-9f76-67e858a6517f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.640957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b54f-1772-46ea-9f76-67e858a6517f None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.642060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884b54f-1772-46ea-9f76-67e858a6517f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:35.642549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884b54f-1772-46ea-9f76-67e858a6517f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.644522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884b54f-1772-46ea-9f76-67e858a6517f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.658801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 407/824] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:35.660053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9007be-28b3-48bf-98fc-b6a534a58180 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.660349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9007be-28b3-48bf-98fc-b6a534a58180 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.660629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9007be-28b3-48bf-98fc-b6a534a58180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.679064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8e9007be-28b3-48bf-98fc-b6a534a58180 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:35.680300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8e9007be-28b3-48bf-98fc-b6a534a58180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:35.749717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a7fe0-fd90-45a2-b5d4-05464fa5acf1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.763283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 408/825] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:35.763283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9007be-28b3-48bf-98fc-b6a534a58180 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.786366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.786974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.788312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.788592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.799977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.801441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.807016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:35.818015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:35.819297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:35.820211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:35.820211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:35.820211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:35.820211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:35.820211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 418/826] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:35.820211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.846064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:35.890155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9007be-28b3-48bf-98fc-b6a534a58180 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.924297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237395c8-aa71-4639-a426-0150b35855a3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:35.926219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.926958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.927239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.928107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.928971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] RBAC: Adding query filter params (name=network) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:35.929280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.930649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.940176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 409/827] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:35.940176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:35.966063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:35.966737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:35.967019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:35.967319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a3d53b503346487fa4d707623ab4cec2/roles/ee92e7b31add479ea825c953e000b04d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:35.984031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=a3d53b503346487fa4d707623ab4cec2, role_id=ee92e7b31add479ea825c953e000b04d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:35.985496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:35.999500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 419/828] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:35 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a3d53b503346487fa4d707623ab4cec2/roles/ee92e7b31add479ea825c953e000b04d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:05:36.000310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.058952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:36.063165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06486e9-ec3f-4590-8a96-7b0f3122d30b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.090234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:36.107740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.108400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.108684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.108964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.121343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:36.125542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31527530-7404-49c8-9957-dc4b6f084431 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:36.126319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:36.127255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:36.128196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 410/829] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:36.129467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.171203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6b7d-5c4f-47e1-9c23-4905ece21f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.171857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6b7d-5c4f-47e1-9c23-4905ece21f3a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.172130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6b7d-5c4f-47e1-9c23-4905ece21f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.172393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6b7d-5c4f-47e1-9c23-4905ece21f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.173089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6b7d-5c4f-47e1-9c23-4905ece21f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:36.173388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6b7d-5c4f-47e1-9c23-4905ece21f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.174750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6b7d-5c4f-47e1-9c23-4905ece21f3a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.186840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 420/830] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:36.188074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857d79-5d52-4520-9fc0-b308037f4572 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.188366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857d79-5d52-4520-9fc0-b308037f4572 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.188641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857d79-5d52-4520-9fc0-b308037f4572 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.190077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 421/831] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:36.190777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c857d79-5d52-4520-9fc0-b308037f4572 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.253234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb00efa-c16b-4b2e-8da7-be23f9020c9b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.289764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.290388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.290669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.290946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.291658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] RBAC: Adding query filter params (type=network) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:36.291964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.293324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.298210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 411/832] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:36.299001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.315990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c857d79-5d52-4520-9fc0-b308037f4572 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.327233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:36.347346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:36.357468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e0e8d-4763-49b6-8cbf-164c45a494d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.358207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0e8d-4763-49b6-8cbf-164c45a494d3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.358582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0e8d-4763-49b6-8cbf-164c45a494d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.358953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0e8d-4763-49b6-8cbf-164c45a494d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.359790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e0e8d-4763-49b6-8cbf-164c45a494d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:36.360192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e0e8d-4763-49b6-8cbf-164c45a494d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.361666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e0e8d-4763-49b6-8cbf-164c45a494d3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.376450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 422/833] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:36.377764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b668f-9bde-4537-941e-b59a078769e2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.378215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b668f-9bde-4537-941e-b59a078769e2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.378612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b668f-9bde-4537-941e-b59a078769e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.399950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3c8b668f-9bde-4537-941e-b59a078769e2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:36.401154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3c8b668f-9bde-4537-941e-b59a078769e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:36.410951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668844a-9d0a-4699-a8ea-e3219164c467 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.451422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.452116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.452398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.452682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.461155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.462595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.472800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 423/834] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:36.473848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b668f-9bde-4537-941e-b59a078769e2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:36.474593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:36.475641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:36.476573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:36.480665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 412/835] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:36.481497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.570192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:36.587156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b668f-9bde-4537-941e-b59a078769e2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.587992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77ae92-f3b9-4a11-8712-20daf9695845 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.615468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:36.626711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.627548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.627901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.628244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.629267 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.629957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.630335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.630650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.631526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.632920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.640975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.642731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.656216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 424/836] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:05:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:36.657051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:36.659201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:36.660437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:36.661589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:36.661589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:36.661589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:36.661589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:36.666410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 413/837] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:36.668518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.813384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dc75f-61ce-47a0-86d9-c61375a17027 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.821050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8480-4651-4267-8ba0-221aa4f8476f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:36.860444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.861379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.861665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.861942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.862581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.863983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.864443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:36.865162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:36.865512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:36.865907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:36.866726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:36.867105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:36.867216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:36.868836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:36.875763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:36.877024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:36.878123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:36.881424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 414/838] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:36.882969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.886084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 425/839] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:36.891617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:36.940307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:37.005095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b943ff-30e9-45a4-a7bb-0888c46bcb00 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.012654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8411-87bb-4f69-a0ed-5bc218252475 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.043332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.044088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.044471 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.044847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.045637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:37.046073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.047469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.050944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.051595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.051880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.052282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.053314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:37.053314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.054827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.060205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 415/840] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:37.061206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:37.064969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 426/841] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:37.065838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:37.128631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:37.173510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950dc60-a296-46ad-8594-4541e96e8e0b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.188897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:37.194324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819904e-6a7c-4cf4-b8a4-19e42c0d5b08 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.211248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.211907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.212193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.212472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.213258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a61ebb13ad8c483fa715e5f6906b05f0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:37.213573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.215001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.231298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 416/842] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:37 2022] GET /identity/v3/role_assignments?user.id=a61ebb13ad8c483fa715e5f6906b05f0&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:37.231298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:37.256690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.257422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.257707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.257983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.266788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.268578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:37.285996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:37.287101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 04:05:37.288110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:37.293955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 427/843] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:05:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:37.295790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:37.352269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4ce2-d081-4e86-b381-f95f1606f14d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.379992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:37.394612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.395241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.395586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.395868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.397079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:37.397390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.398759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.411727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 417/844] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:37.414859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039a8a2-12d1-44f8-bfd0-9f42fe52cabe None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.454814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.455497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.455779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.456060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.456954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:37.457271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.459419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.480539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 428/845] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 04:05:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:37.486494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:37.600254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee4f28-cf0c-49f9-893e-686fee74e7ff None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.636408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.637119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.637502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.637881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.696679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:37.709460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.711238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.816114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 418/846] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:05:37.822428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:37.864329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:37.932230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de188-1fa0-46f1-aea5-8bcfa82c60d6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:37.967769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412004-a87e-4fc9-8831-389a798565ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:37.968721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412004-a87e-4fc9-8831-389a798565ae None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:37.969146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412004-a87e-4fc9-8831-389a798565ae None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:37.969563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412004-a87e-4fc9-8831-389a798565ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:37.980801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412004-a87e-4fc9-8831-389a798565ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:37.982470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412004-a87e-4fc9-8831-389a798565ae None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-97412004-a87e-4fc9-8831-389a798565ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:37.998793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:37.999958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:38.001093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:38.001093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:38.001093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:38.001093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:38.002889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 429/847] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:38.009857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.051426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6c28-135b-45f4-815e-8707a3fbcf32 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.051973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6c28-135b-45f4-815e-8707a3fbcf32 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.053417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6c28-135b-45f4-815e-8707a3fbcf32 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.055539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 430/848] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:38.061574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd517-92e8-4944-9987-1937437f7424 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.061857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd517-92e8-4944-9987-1937437f7424 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.062132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd517-92e8-4944-9987-1937437f7424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.086192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2f9cd517-92e8-4944-9987-1937437f7424 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:38.087922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2f9cd517-92e8-4944-9987-1937437f7424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:38.109983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:38.124813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d66b4-89b0-415f-bb5b-4b961b2ef178 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.162899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.163894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.164419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.164845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.165710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:38.166164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:38.167573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:38.169079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:38.179288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 431/849] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:38.187771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 419/850] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:38.193413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cd517-92e8-4944-9987-1937437f7424 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.200334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.310934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cd517-92e8-4944-9987-1937437f7424 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.316218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b501d5-2295-4def-baad-044245bc3075 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.356627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.357683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.358172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.358369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.358858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.358978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.359225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.359534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.367898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:38.370002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:38.371554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:38.377694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:38.378643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:05:38.379567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:38.384495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 420/851] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:38.385740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:38.387301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:38.388174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:38.389088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:38.392022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 432/852] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:38.401699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.403456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:38.484319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:38.523893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e23dc-2bbb-4be8-96a0-8ec68363debc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.546635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba878b-4e4f-4fb1-986c-e4c76c932b3c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.561808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.562604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.562789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.563054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.563830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:38.564140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:38.565666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:38.580668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 421/853] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:38.581682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.593322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.594722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.595215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.596158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.597414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:38.597968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:38.600745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:38.616827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 433/854] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:38.623214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.664836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:38.697439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5ad0d-0e16-4209-ac03-142785b43708 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.732835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.733650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.734033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.734463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.746127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:38.747234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a14c78-4bfb-4ee8-9056-64a5a5d6c683 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.747878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:38.763206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:38.764346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:38.765481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:38.765481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:38.765481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:38.765481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:38.771978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 422/855] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:38.772897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:38.773612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:38.790301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.791324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.791778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.792202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.793246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=11cd9091a4654f5eb689e23061b6e52e) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:38.793746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:38.795546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:38.811404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 434/856] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/role_assignments?user.id=11cd9091a4654f5eb689e23061b6e52e&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:38.889066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cdfd3-b654-4ccb-b0e8-fc703d8bf8c0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:38.914470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:38.927068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:38.928515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:38.928868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:38.929366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:38.930082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:38.930389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:38.931829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:38.946672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 423/857] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:38.952278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:39.066052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b03ad-08a3-432e-97d3-6c9c054a645c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:39.108545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:39.109198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.109478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.109752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.119233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:39.120788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:39.132710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:39.133698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:39.135587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 435/858] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:05:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:39.140023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:39.244486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5953a-9e82-43d3-9b4a-acd3b40e4d66 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:39.281255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289530ee-ae50-440f-b64d-992cb8a66fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:39.281872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289530ee-ae50-440f-b64d-992cb8a66fba None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.282152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289530ee-ae50-440f-b64d-992cb8a66fba None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.282427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289530ee-ae50-440f-b64d-992cb8a66fba None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.283216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289530ee-ae50-440f-b64d-992cb8a66fba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:39.283549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289530ee-ae50-440f-b64d-992cb8a66fba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:39.284974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289530ee-ae50-440f-b64d-992cb8a66fba None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:39.304101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 424/859] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 04:05:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:39.309676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:39.360221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:39.398077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac942a7-6987-4755-af64-8383f0f7111a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.398309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac942a7-6987-4755-af64-8383f0f7111a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.398481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac942a7-6987-4755-af64-8383f0f7111a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.400104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 425/860] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:39.405084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535f150-662f-4895-9c4c-65c51023f993 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.405371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535f150-662f-4895-9c4c-65c51023f993 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.405650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535f150-662f-4895-9c4c-65c51023f993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.421596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dde53c-b974-4d9f-8f08-8ee977043305 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:39.423946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4535f150-662f-4895-9c4c-65c51023f993 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:39.425224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4535f150-662f-4895-9c4c-65c51023f993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:39.459015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:39.460369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.460855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.461303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.492744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:39.514944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 426/861] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:39.516323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0553d7-af6d-45ab-b113-0c3088584e55 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.516618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0553d7-af6d-45ab-b113-0c3088584e55 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.516897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0553d7-af6d-45ab-b113-0c3088584e55 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.518300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 427/862] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:39.524408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3c23-a182-482f-a607-456f131f1a18 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.524821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3c23-a182-482f-a607-456f131f1a18 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.525204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3c23-a182-482f-a607-456f131f1a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.543071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:39.544909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:39.545325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8bce3c23-a182-482f-a607-456f131f1a18 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:39.546518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8bce3c23-a182-482f-a607-456f131f1a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:39.600134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:39.617609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 428/863] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:39.628152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3c23-a182-482f-a607-456f131f1a18 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:39.667643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 436/864] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:05:39.668539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:39.737914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:39.744874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3c23-a182-482f-a607-456f131f1a18 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:39.780441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6a31-dc02-440e-8fa4-d4423310b1e3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:39.781982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:39.782862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.783209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.783607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.784243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:39.785604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:39.795186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:39.796185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:39.800232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 429/865] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jul 27 04:05:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:39.801133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:39.822200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:39.822821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:39.823104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:39.823580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:39.824280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:39.825688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:39.840063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 437/866] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:39 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:39.848803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:39.855867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:39.948530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea92ef-cae5-446b-babe-89b677d83d9e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:39.983354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce119c36-add7-40c0-ae42-946c9b69d343 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:40.001541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:40.002250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.002528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.003048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.016653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:40.018176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:40.025309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:40.025959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.026244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.026522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.027233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:40.027614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:40.029057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:40.034603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 438/867] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:40.036655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:40.037589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:40.039009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:40.039009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:40.039009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:40.039009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:40.039009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 430/868] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:40.041971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:40.043707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:40.063854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:40.125397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:40.166214 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe30e2-87c7-4499-9a7f-65b13c871194 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:40.176472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addf535-e8b3-4a2b-b469-bcd9a79c0af0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:40.206349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:40.207640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.208138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.209199 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.210661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:40.211256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:40.212828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:40.219696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:40.220320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.220605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.220879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.222111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:40.222451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:40.223857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:40.228750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 431/869] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:40.233886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 439/870] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:40.235220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:40.332686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:40.364351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57000682-6586-41ac-83e9-5f40789e2c29 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:40.408530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:40.409048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.409323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.409601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.417402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:40.418859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:40.431097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:40.432147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:40.433507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 432/871] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:40.438018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:40.544026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa16d5-46d9-4878-bc92-2f50718129ac None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:40.571506 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:40.579781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c846235-ddc5-407f-bb17-3b6c64c6f1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:40.580735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846235-ddc5-407f-bb17-3b6c64c6f1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.581231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846235-ddc5-407f-bb17-3b6c64c6f1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.581708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846235-ddc5-407f-bb17-3b6c64c6f1c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.582694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c846235-ddc5-407f-bb17-3b6c64c6f1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:40.583210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c846235-ddc5-407f-bb17-3b6c64c6f1c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:40.585796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c846235-ddc5-407f-bb17-3b6c64c6f1c7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:40.603477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 440/872] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:40.606182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:40.713343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0645c-c474-479e-9cdb-accacbc7ebb0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:40.749823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac200ed-20df-4ded-bfd4-bce8d22cb9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:40.750454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac200ed-20df-4ded-bfd4-bce8d22cb9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.750739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac200ed-20df-4ded-bfd4-bce8d22cb9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.751018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac200ed-20df-4ded-bfd4-bce8d22cb9f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.751850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac200ed-20df-4ded-bfd4-bce8d22cb9f6 None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a3d53b503346487fa4d707623ab4cec2) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:40.752165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac200ed-20df-4ded-bfd4-bce8d22cb9f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:40.753606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac200ed-20df-4ded-bfd4-bce8d22cb9f6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:40.757267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:40.761152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 433/873] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:40 2022] GET /identity/v3/role_assignments?user.id=a3d53b503346487fa4d707623ab4cec2&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:40.941479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d5fe-cb75-46a8-bac7-64fdb871d596 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.941776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d5fe-cb75-46a8-bac7-64fdb871d596 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.941954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d5fe-cb75-46a8-bac7-64fdb871d596 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.944129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 441/874] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:40.949346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c612-ba76-4ab7-87a7-7c26d5e08295 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:40.949635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c612-ba76-4ab7-87a7-7c26d5e08295 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:40.949912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c612-ba76-4ab7-87a7-7c26d5e08295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:40.968500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2000c612-ba76-4ab7-87a7-7c26d5e08295 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:40.969697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2000c612-ba76-4ab7-87a7-7c26d5e08295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:41.044240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 434/875] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:41.065511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d5fe-cb75-46a8-bac7-64fdb871d596 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:41.176833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d5fe-cb75-46a8-bac7-64fdb871d596 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:41.213739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:41.214620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:41.215053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:41.215536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:41.216314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:41.217841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:41.227852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:41.229086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:41.230157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:41.232614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 442/876] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:41.239332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000c612-ba76-4ab7-87a7-7c26d5e08295 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:41.346468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000c612-ba76-4ab7-87a7-7c26d5e08295 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:41.380349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:41.384427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3514ff3-5f5a-47a7-b4cd-e162c1917013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:41.385055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514ff3-5f5a-47a7-b4cd-e162c1917013 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:41.385341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514ff3-5f5a-47a7-b4cd-e162c1917013 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:41.385665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514ff3-5f5a-47a7-b4cd-e162c1917013 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:41.386350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3514ff3-5f5a-47a7-b4cd-e162c1917013 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:41.386662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3514ff3-5f5a-47a7-b4cd-e162c1917013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:41.388109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3514ff3-5f5a-47a7-b4cd-e162c1917013 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:41.394067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 435/877] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:41.400716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:41.456766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:41.513697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77de4c-6471-4cf0-8601-fbcc548ebabe None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:41.550949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be97d-adce-432f-a134-8950340a0d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:41.551852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be97d-adce-432f-a134-8950340a0d41 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:41.552334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be97d-adce-432f-a134-8950340a0d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:41.552762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be97d-adce-432f-a134-8950340a0d41 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:41.553617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be97d-adce-432f-a134-8950340a0d41 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:41.554077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be97d-adce-432f-a134-8950340a0d41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:41.555625 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be97d-adce-432f-a134-8950340a0d41 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:41.560917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 443/878] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:42.045361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cb39b-977f-4d09-bf51-227a8d664189 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.045758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cb39b-977f-4d09-bf51-227a8d664189 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.045986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cb39b-977f-4d09-bf51-227a8d664189 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.047546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 436/879] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:42.053623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0970bd-2e89-404a-b8c2-dbfb4b56c776 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.053910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0970bd-2e89-404a-b8c2-dbfb4b56c776 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.054188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0970bd-2e89-404a-b8c2-dbfb4b56c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.073956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6c0970bd-2e89-404a-b8c2-dbfb4b56c776 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:42.075362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6c0970bd-2e89-404a-b8c2-dbfb4b56c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:42.148186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 444/880] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:42.170647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cb39b-977f-4d09-bf51-227a8d664189 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:42.294392 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cb39b-977f-4d09-bf51-227a8d664189 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:42.331723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:42.332291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.332617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.332899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.333586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:42.336053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:42.345910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:42.348001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:42.349672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 437/881] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:42.355368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0970bd-2e89-404a-b8c2-dbfb4b56c776 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:42.406253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:42.466544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0970bd-2e89-404a-b8c2-dbfb4b56c776 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:42.514972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e4e5c-71e9-48c6-aaae-d6d49d8781d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:42.516086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e4e5c-71e9-48c6-aaae-d6d49d8781d0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.516574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e4e5c-71e9-48c6-aaae-d6d49d8781d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.517057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e4e5c-71e9-48c6-aaae-d6d49d8781d0 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.518251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e4e5c-71e9-48c6-aaae-d6d49d8781d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:42.518910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e4e5c-71e9-48c6-aaae-d6d49d8781d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:42.521849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e4e5c-71e9-48c6-aaae-d6d49d8781d0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:42.530527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 445/882] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:42.535890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:42.559773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5721d19-2a0e-45c5-aa63-ee8bef661bcb None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.560709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5721d19-2a0e-45c5-aa63-ee8bef661bcb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.561493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5721d19-2a0e-45c5-aa63-ee8bef661bcb None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.563430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 446/883] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:42.569672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da46262-74ed-48b9-9077-1f1519a6f5db None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.570296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da46262-74ed-48b9-9077-1f1519a6f5db None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.571079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da46262-74ed-48b9-9077-1f1519a6f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.594845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4da46262-74ed-48b9-9077-1f1519a6f5db None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:42.596416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4da46262-74ed-48b9-9077-1f1519a6f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:42.601905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:42.648280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb687-dc28-4d46-8c62-773a6a12fe00 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:42.686872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:42.687364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.687641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.687905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.688590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:42.688893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:42.690446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:42.701229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 438/884] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:42.702181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:42.710417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 447/885] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:42.740359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da46262-74ed-48b9-9077-1f1519a6f5db None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:42.797300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:42.842594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4323c-1d56-471d-ab66-ee44308baa68 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:42.871194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:42.884415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da46262-74ed-48b9-9077-1f1519a6f5db None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:42.888485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:42.889477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.890022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.890507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.891505 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] RBAC: Adding query filter params (interface=public, service_id=d9ef0a6c69f8431dbaaa9f4fda9837be, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:42.892018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:42.893594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:42.909845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 439/886] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:05:42 2022] GET /identity/v3/endpoints?service_id=d9ef0a6c69f8431dbaaa9f4fda9837be&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:42.911630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:42.932150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be049aaa-8925-4a96-a246-0180ce84e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:42.932150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049aaa-8925-4a96-a246-0180ce84e188 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:42.932150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049aaa-8925-4a96-a246-0180ce84e188 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:42.932150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049aaa-8925-4a96-a246-0180ce84e188 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:42.932585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be049aaa-8925-4a96-a246-0180ce84e188 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:42.932585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be049aaa-8925-4a96-a246-0180ce84e188 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:42.959290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 448/887] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:42 2022] POST /identity/v3/services => generated 269 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:05:43.041209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c466da-2c7f-4b27-a3bd-cbb03105d480 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.041551 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c466da-2c7f-4b27-a3bd-cbb03105d480 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.041775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c466da-2c7f-4b27-a3bd-cbb03105d480 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.043597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 449/888] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:43.046063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9f23-681f-4b36-a4a1-e3de693e729e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:43.049358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff052f-06f1-47a6-9b82-54a8bb801bf4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.049630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff052f-06f1-47a6-9b82-54a8bb801bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.049903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff052f-06f1-47a6-9b82-54a8bb801bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.070019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9cff052f-06f1-47a6-9b82-54a8bb801bf4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:43.071252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9cff052f-06f1-47a6-9b82-54a8bb801bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:43.100713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:43.101356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.101643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.101936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.102585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:43.104027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:43.111311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 440/889] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:05:42 2022] GET /identity/v3/services => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:05:43.158163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 450/890] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:43.181945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:43.238426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:43.301583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b1697-00a7-4c3d-b3d3-5eb3bda92075 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:43.338284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:43.338935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.339217 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.339524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.350939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:43.356313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:43.357274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:43.358147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 441/891] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 04:05:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:43.363478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff052f-06f1-47a6-9b82-54a8bb801bf4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:43.398032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:43.475687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff052f-06f1-47a6-9b82-54a8bb801bf4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:43.515910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c172d-c7f3-4860-b9e7-370fdc5f935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:43.516533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c172d-c7f3-4860-b9e7-370fdc5f935b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.516812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c172d-c7f3-4860-b9e7-370fdc5f935b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.517086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c172d-c7f3-4860-b9e7-370fdc5f935b None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.517795 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c172d-c7f3-4860-b9e7-370fdc5f935b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:43.518100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c172d-c7f3-4860-b9e7-370fdc5f935b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:43.519490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c172d-c7f3-4860-b9e7-370fdc5f935b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:43.528767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 451/892] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 04:05:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:43.534289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:43.643290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a553f-c27d-4838-a0a7-08275854d889 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:43.650759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:43.679024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:43.679699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.679981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.680260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.691203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:43.692680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:43.705100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107e45-3a0b-4cf0-be69-20f8c280ea23 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.705437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107e45-3a0b-4cf0-be69-20f8c280ea23 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.705650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107e45-3a0b-4cf0-be69-20f8c280ea23 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.707236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 452/893] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:43.708091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:43.709815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:43.710736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:43.710736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:43.710736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:43.710736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:43.710736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 442/894] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:43.712694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84ed2-4bcb-4089-8c7c-fffc68d34a15 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.712981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84ed2-4bcb-4089-8c7c-fffc68d34a15 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.713256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84ed2-4bcb-4089-8c7c-fffc68d34a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.717269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:43.731566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a2d84ed2-4bcb-4089-8c7c-fffc68d34a15 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:43.732677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a2d84ed2-4bcb-4089-8c7c-fffc68d34a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:43.811542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 453/895] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:43.831640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84ed2-4bcb-4089-8c7c-fffc68d34a15 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:43.837983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adad21-a2dd-4e6b-b590-bf47532af608 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:43.872648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:43.873551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:43.874012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:43.874463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:43.875353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:43.875865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:43.877409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:43.887621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:43.891000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 443/896] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:43.899862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:43.925467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:43.960060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84ed2-4bcb-4089-8c7c-fffc68d34a15 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:44.008107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:44.010077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:44.010578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:44.011304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:44.012788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:44.015120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:44.017754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1448-08c5-43fe-971a-c632c124513e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:44.036594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 454/897] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:43 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:05:44.069568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:44.070259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:44.070540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:44.070812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:44.079681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:44.081260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:44.096310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:44.098015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:44.099779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 444/898] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:05:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:44.109325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:44.203612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:44.226872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282adc0-16bb-4904-af70-d58abdab7770 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:44.267772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:44.268337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:44.268621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:44.268899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:44.269735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:44.270048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:44.271667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:44.291849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 455/899] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 04:05:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:44.297161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:44.378244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:44.409765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1d7e9-6968-4a09-9144-ec4c80bc9cb2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:44.445444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:44.446302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:44.446730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:44.447151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:44.517736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:44.519555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:44.596706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:44.624366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 445/900] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:05:44.635306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:44.744972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925efd8-ba7a-4f87-8333-1a7d3fe80352 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:44.783743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:44.784761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:44.785242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:44.785734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:44.797460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:44.801038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:44.802905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:44.820342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:44.821301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:44.822200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:44.822200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:44.822200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:44.822200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:44.824535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 456/901] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:44.830281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:44.938092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e840307-0b9c-4d8c-9562-1669ebfd42a1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:44.973920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d172-e15b-47fa-aeed-fedd3314c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:44.975038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d172-e15b-47fa-aeed-fedd3314c9da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:44.975354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d172-e15b-47fa-aeed-fedd3314c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:44.975719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d172-e15b-47fa-aeed-fedd3314c9da None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:44.976403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d172-e15b-47fa-aeed-fedd3314c9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:44.976706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d172-e15b-47fa-aeed-fedd3314c9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:44.978066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d172-e15b-47fa-aeed-fedd3314c9da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:44.990624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 446/902] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:44.996069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.103436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb915cb-67a8-420f-914b-9569a02d38f8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.142131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.143171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.143686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.144163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.152188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.153906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:45.165925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:45.166864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:45.167831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:45.170342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 457/903] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:45.175280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09b88-bd61-4079-b16f-c45531f4cc43 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.175280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09b88-bd61-4079-b16f-c45531f4cc43 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.175280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af09b88-bd61-4079-b16f-c45531f4cc43 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.175280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 447/904] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:45.176619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.178873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0cb5c-3078-4ba5-98b4-c54a39819770 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.179233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0cb5c-3078-4ba5-98b4-c54a39819770 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.179551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0cb5c-3078-4ba5-98b4-c54a39819770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.197965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-90f0cb5c-3078-4ba5-98b4-c54a39819770 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:45.199142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-90f0cb5c-3078-4ba5-98b4-c54a39819770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:45.229527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:45.242520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:45.276366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 448/905] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:45.278058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472696a-9d67-48a0-a2eb-3686695ad109 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.278349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472696a-9d67-48a0-a2eb-3686695ad109 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.278629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472696a-9d67-48a0-a2eb-3686695ad109 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.283766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 449/906] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:45.284985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0776800-19c3-4787-b637-46cd75d8b85e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.285268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0776800-19c3-4787-b637-46cd75d8b85e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.285538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0776800-19c3-4787-b637-46cd75d8b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.303863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a6e43-3e9c-4fe0-9e1b-163d032da075 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.304706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a0776800-19c3-4787-b637-46cd75d8b85e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:45.305888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a0776800-19c3-4787-b637-46cd75d8b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:45.339633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.340252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.340535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.340803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.341561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:45.341870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.343323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.361799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 458/907] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:45.362658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.375799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 450/908] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:45.376639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0776800-19c3-4787-b637-46cd75d8b85e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.475041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702eef78-7f9d-4cc6-9582-b12adb5c2716 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.481795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:45.488920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0776800-19c3-4787-b637-46cd75d8b85e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.490879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:45.515350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.515984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.516266 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.516531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.517153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.518509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.525725 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.526346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.526630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.526908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.527755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] RBAC: Adding query filter params (role.id=541aaf73a5b241ff94e7416ccfff8606, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a3d53b503346487fa4d707623ab4cec2) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:45.527922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:45.528883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 04:05:45.532076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:45.532841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.532915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 459/909] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:45.532984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.533052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.537547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 451/910] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/role_assignments?user.id=a3d53b503346487fa4d707623ab4cec2&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=541aaf73a5b241ff94e7416ccfff8606 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:45.548831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.676407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cfdef-e0b2-4f55-bfec-5b39eecce8a7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.703293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff48c-9cd7-4c6c-96f3-107caf67b71f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.716642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.717295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.717570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.717845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.718481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.719935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:45.729444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:45.730520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:45.731398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:45.735530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 460/911] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:45.736510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.752745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.753749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.754226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.754570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.755928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:45.756320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.757984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.763914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 452/912] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:45.769738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.786117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:45.803610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:45.872722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ce26-ea32-4bba-9c35-999bc620a74e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.909156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd970470-5704-47ef-bdc3-9eea8edd18fb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:45.920069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.921443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.921879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.922695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.923860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:45.924321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.926661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.938187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 461/913] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:45.938603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:45.956544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:45.957173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:45.957475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:45.957998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:45.959422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:45.959729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:45.961375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:45.968474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 453/914] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:45.976768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:46.060709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24be7-dc3c-499e-9032-c4487adae9e6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:46.064207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:46.095176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:46.100752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:46.101693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.102058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.102435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.103208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:46.103658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:46.105128 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:46.110781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 462/915] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:46.118555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07586a3-6bea-400b-8536-e40cc31d581e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:46.120292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:46.160820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9feb5-9066-4846-9932-f6bc38104543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:46.161470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9feb5-9066-4846-9932-f6bc38104543 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.162305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9feb5-9066-4846-9932-f6bc38104543 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.162672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9feb5-9066-4846-9932-f6bc38104543 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.163582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9feb5-9066-4846-9932-f6bc38104543 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:46.164955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9feb5-9066-4846-9932-f6bc38104543 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:46.187435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 454/916] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:05:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:05:46.187435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab90d8-12ae-4423-a27e-e132535cb83e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.187435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab90d8-12ae-4423-a27e-e132535cb83e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.187435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab90d8-12ae-4423-a27e-e132535cb83e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.188147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 455/917] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:46.202974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce568a-f30e-43e4-83c0-b3765ed0f5dd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.203364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce568a-f30e-43e4-83c0-b3765ed0f5dd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.203573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce568a-f30e-43e4-83c0-b3765ed0f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.230409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-81ce568a-f30e-43e4-83c0-b3765ed0f5dd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:46.233071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-81ce568a-f30e-43e4-83c0-b3765ed0f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:46.244641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ba78-2e55-4aa9-92bf-85317601225a None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:46.291701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:46.292339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.292620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.292954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.293731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] RBAC: Adding query filter params (interface=public, service_id=713ca3ef70ea41448bbf59bcf4e3d784, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:46.294069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:46.296173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:46.307305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 463/918] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:05:46 2022] GET /identity/v3/endpoints?service_id=713ca3ef70ea41448bbf59bcf4e3d784&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:46.309470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:46.331158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 456/919] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:46.348118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:46.355347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce568a-f30e-43e4-83c0-b3765ed0f5dd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:46.444034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44f588-3d6e-4a4b-8d03-52b1d318f4a6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:46.455649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:46.485959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce568a-f30e-43e4-83c0-b3765ed0f5dd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:46.491753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:46.492498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.492883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.493265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.494033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:46.495534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:46.509384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 464/920] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:05:46 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:05:46.532275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:46.532941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.533226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.533504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.534149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:46.535658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:46.546519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:46.547676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:46.548566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 457/921] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:46.555026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:46.658253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:46.668583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5441216-a8b2-4bce-b734-6f96f7827311 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:46.708017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:46.709247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.709389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.709661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.710374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:46.710678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:46.712153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:46.721632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 465/922] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:46.728016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:46.849835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8d33-e95b-4176-bde4-f0679645db17 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:46.885676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:46.886305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:46.886590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:46.886871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:46.887592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:46.887902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:46.889271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:46.891495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:46.896676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 458/923] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:46.902357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:47.010927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfe9a9-0df6-48d8-8381-deebb446f682 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:47.048993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86c1cc-3561-4d6e-858f-b9d219a1508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:47.049608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c1cc-3561-4d6e-858f-b9d219a1508d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:47.049889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c1cc-3561-4d6e-858f-b9d219a1508d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:47.050156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c1cc-3561-4d6e-858f-b9d219a1508d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:47.050911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86c1cc-3561-4d6e-858f-b9d219a1508d None admin] RBAC: Adding query filter params (interface=public, service_id=1033bd014ff24de08f88c95ef8340410, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:47.051220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86c1cc-3561-4d6e-858f-b9d219a1508d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:47.052767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86c1cc-3561-4d6e-858f-b9d219a1508d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:47.058211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 466/924] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:05:46 2022] GET /identity/v3/endpoints?service_id=1033bd014ff24de08f88c95ef8340410&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:47.063734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:47.172606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9aa3e-79c6-4592-a3c5-3ecaef23c472 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:47.207455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486c809-7075-46d3-bd9c-92f67ffb2bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:47.208079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c809-7075-46d3-bd9c-92f67ffb2bcb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:47.208900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c809-7075-46d3-bd9c-92f67ffb2bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:47.209177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c809-7075-46d3-bd9c-92f67ffb2bcb None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:47.209844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486c809-7075-46d3-bd9c-92f67ffb2bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:47.211204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486c809-7075-46d3-bd9c-92f67ffb2bcb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:47.217791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 459/925] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:05:47 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:05:47.651278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09f89-0099-4157-805a-e32bdb7b3d89 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:47.651693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09f89-0099-4157-805a-e32bdb7b3d89 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:47.651872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed09f89-0099-4157-805a-e32bdb7b3d89 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:47.653381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 467/926] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:47.658565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d7fb4-653e-4ea5-b06f-bcb86a6e0867 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:47.659015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d7fb4-653e-4ea5-b06f-bcb86a6e0867 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:47.659114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d7fb4-653e-4ea5-b06f-bcb86a6e0867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:47.678491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5d4d7fb4-653e-4ea5-b06f-bcb86a6e0867 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:47.679750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5d4d7fb4-653e-4ea5-b06f-bcb86a6e0867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:47.751411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:47.767601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 460/927] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:47.783634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed09f89-0099-4157-805a-e32bdb7b3d89 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:47.806624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:47.894704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed09f89-0099-4157-805a-e32bdb7b3d89 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:47.932200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:47.932770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:47.933051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:47.933326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:47.945186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:47.950246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:47.951292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:47.952908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 468/928] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 04:05:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:47.957312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d7fb4-653e-4ea5-b06f-bcb86a6e0867 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.064781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d7fb4-653e-4ea5-b06f-bcb86a6e0867 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:48.101629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:48.102267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.102551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.102832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.103581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:48.103889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:48.105257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:48.113863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 461/929] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 04:05:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:48.119205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.209854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:48.229342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353671c-979d-427f-92d4-8ad55d802952 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:48.264417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe89f8-6324-4bff-a5ac-8ab8025ac39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:48.265061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe89f8-6324-4bff-a5ac-8ab8025ac39e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.265339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe89f8-6324-4bff-a5ac-8ab8025ac39e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.265613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe89f8-6324-4bff-a5ac-8ab8025ac39e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.277478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe89f8-6324-4bff-a5ac-8ab8025ac39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:48.278943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe89f8-6324-4bff-a5ac-8ab8025ac39e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-cdfe89f8-6324-4bff-a5ac-8ab8025ac39e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:48.293477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:48.295480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:48.296462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:48.296462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:48.296462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:48.296462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.296462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 469/930] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:48.300439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.359691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:48.377228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b640c-115d-418d-a787-769770b23278 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.377572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b640c-115d-418d-a787-769770b23278 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.377780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b640c-115d-418d-a787-769770b23278 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.379521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 470/931] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:48.385979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ab576-2d3c-4597-b2f3-8ec2c94b97f0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.386312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ab576-2d3c-4597-b2f3-8ec2c94b97f0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.386518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ab576-2d3c-4597-b2f3-8ec2c94b97f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.408204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-172ab576-2d3c-4597-b2f3-8ec2c94b97f0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:48.410218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-172ab576-2d3c-4597-b2f3-8ec2c94b97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:48.412406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120ed6-da68-49d3-9908-4ea29bd6314c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:48.454426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:48.455100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.455417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.455693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.456442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:48.456754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:48.458786 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:48.478021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 462/932] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:48.479044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.507351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 471/933] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:48.535169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ab576-2d3c-4597-b2f3-8ec2c94b97f0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.592911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da370e1c-a724-4ad3-b216-e0daa21e6c7f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:48.607309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:48.612923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:48.634467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:48.635116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.635436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.635716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.643817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:48.645360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:48.649417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ab576-2d3c-4597-b2f3-8ec2c94b97f0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:48.658545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:48.661309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:48.664467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:48.667290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 463/934] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:05:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:48.667290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.686624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:48.687216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.687528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.687804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.688481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:48.689920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:48.692553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING keystone.server.flask.common [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 04:05:48.712327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.sql.core [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 04:05:48.712327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 04:05:48.712327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [parameters: {'id': 'bbb09424f4e44912bab8c60dfcb0fb1c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 04:05:48.712327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-11696aa0-3afe-40d9-9ccb-6837b8c31272 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbb09424f4e44912bab8c60dfcb0fb1c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbb09424f4e44912bab8c60dfcb0fb1c. Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 04:05:48.720123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 04:05:48.721044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application yield resource Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application next(self.gen) Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise self.value Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application session.commit() Jul 27 04:05:48.727979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.session.flush() Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application compat.raise_( Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 04:05:48.728953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 04:05:48.729877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application conn.query(q) Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application result.read() Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 04:05:48.730692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [parameters: {'id': 'bbb09424f4e44912bab8c60dfcb0fb1c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:48.733041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:48.735022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbb09424f4e44912bab8c60dfcb0fb1c. Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 472/935] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Jul 27 04:05:48 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b86cd1-a271-4626-b9c7-c47140197550 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.737015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b86cd1-a271-4626-b9c7-c47140197550 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.737868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b86cd1-a271-4626-b9c7-c47140197550 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.737868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 473/936] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:48.737868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b86cd1-a271-4626-b9c7-c47140197550 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.789277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b5e1-b68f-4c8c-b732-79fbbc3afd39 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:48.828298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae1e34-6c4d-47c6-b2bd-b260f1028bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:48.828917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1e34-6c4d-47c6-b2bd-b260f1028bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.829190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1e34-6c4d-47c6-b2bd-b260f1028bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.829461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae1e34-6c4d-47c6-b2bd-b260f1028bd4 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.830249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1e34-6c4d-47c6-b2bd-b260f1028bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:48.830552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1e34-6c4d-47c6-b2bd-b260f1028bd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:48.831999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae1e34-6c4d-47c6-b2bd-b260f1028bd4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:48.848847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b86cd1-a271-4626-b9c7-c47140197550 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:48.851573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 464/937] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 04:05:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:48.857339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7147-8158-43ee-9948-b69c56a95f68 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.857809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7147-8158-43ee-9948-b69c56a95f68 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.858250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7147-8158-43ee-9948-b69c56a95f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.868817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:48.878375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4bbc7147-8158-43ee-9948-b69c56a95f68 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:48.879572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4bbc7147-8158-43ee-9948-b69c56a95f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:48.889195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:48.889832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:48.890115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:48.890390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:48.900563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:48.902154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:48.913292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:48.914284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:48.915223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:48.916191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 474/938] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:48.917282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:48.963065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 465/939] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:48.963731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc7147-8158-43ee-9948-b69c56a95f68 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.035817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353f34c-3c17-49a4-b27c-fa5e3cce35e6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.073666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.074313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.074596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.074697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc7147-8158-43ee-9948-b69c56a95f68 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.074868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.086837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.088661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:49.103253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:49.104432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:49.105525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:49.105525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:49.105525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:49.105525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:49.105525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 475/940] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:49.105525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.118382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.119378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.119836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.120257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.121242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:49.121556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.123139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.137561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:49.155312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 466/941] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:49.155312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.184446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:49.230048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c6918-f813-470e-99bf-365e04d65402 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.273901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936073d-4573-44e5-9457-c8e3ab73fc00 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.278031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.278696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.278979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.279257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.279927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.281325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:49.294270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:49.295395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:49.296713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 476/942] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:49.307605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.326198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bdf82-b7c3-4941-942f-b461754e4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.326833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bdf82-b7c3-4941-942f-b461754e4938 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.327116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bdf82-b7c3-4941-942f-b461754e4938 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.327427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bdf82-b7c3-4941-942f-b461754e4938 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.328137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bdf82-b7c3-4941-942f-b461754e4938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:49.328445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bdf82-b7c3-4941-942f-b461754e4938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.329846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bdf82-b7c3-4941-942f-b461754e4938 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.347438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 467/943] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:49.347438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544d276-3f86-47dd-ac19-94c52ae452c1 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.347438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544d276-3f86-47dd-ac19-94c52ae452c1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.347438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544d276-3f86-47dd-ac19-94c52ae452c1 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.347438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 468/944] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:49.351852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544d276-3f86-47dd-ac19-94c52ae452c1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.429182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19f25c-344a-4bda-8e54-1a2755b12a8d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.430762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:49.453269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:49.468845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108cb1-c22d-4004-a456-332f2e46423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.469477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108cb1-c22d-4004-a456-332f2e46423b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.469763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108cb1-c22d-4004-a456-332f2e46423b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.470042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108cb1-c22d-4004-a456-332f2e46423b None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.470735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108cb1-c22d-4004-a456-332f2e46423b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:49.471047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108cb1-c22d-4004-a456-332f2e46423b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.472468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108cb1-c22d-4004-a456-332f2e46423b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.474712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544d276-3f86-47dd-ac19-94c52ae452c1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.478501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 477/945] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:49.479945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522d38e-36ff-4fe5-8f44-ba08b4a16682 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.480299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522d38e-36ff-4fe5-8f44-ba08b4a16682 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.480649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522d38e-36ff-4fe5-8f44-ba08b4a16682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.500262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8522d38e-36ff-4fe5-8f44-ba08b4a16682 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:49.501809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8522d38e-36ff-4fe5-8f44-ba08b4a16682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:49.513314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.513953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.514240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.514516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.522414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.523893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:49.536455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:49.537548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:49.538491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:49.542460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 469/946] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:49.543318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.574845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 478/947] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:49.575665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522d38e-36ff-4fe5-8f44-ba08b4a16682 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.656323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a0ee5-5362-46ed-bf9c-7cef84574d5e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.671448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:49.686328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522d38e-36ff-4fe5-8f44-ba08b4a16682 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.692284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.693027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.693243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.693522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.694209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:49.694522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.696003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.707682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 470/948] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:49.708661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.719570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:49.729333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.729961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.730237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.730508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.731301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:49.731597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.733035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.746039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 479/949] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:49.746583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.833717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ada6b-388d-4133-8e17-9552aeb6b5f6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.854755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d0801-48e8-45c5-b6fa-c1262b76f4c2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:49.870772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.871460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.871742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.872020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.872650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.874022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:49.883780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:49.885095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:49.885950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 471/950] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:49.886815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.898827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:49.899477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:49.899766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:49.900043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:49.900752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:49.902127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:49.927570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 480/951] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:05:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:49.928943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:49.932900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:49.974901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:50.022344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855b9b-840e-45f3-803b-fb3ee7e14e94 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:50.059329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6248ec-4478-4b07-8b71-ce5392f7fca1 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:50.065719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:50.066512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:50.066868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:50.067244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a3d53b503346487fa4d707623ab4cec2/roles/541aaf73a5b241ff94e7416ccfff8606` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:50.070490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=a3d53b503346487fa4d707623ab4cec2, role_id=541aaf73a5b241ff94e7416ccfff8606)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:50.072733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:50.097143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 472/952] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:05:49 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a3d53b503346487fa4d707623ab4cec2/roles/541aaf73a5b241ff94e7416ccfff8606 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:05:50.113658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:50.115421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:50.115933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:50.116405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:50.117362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:50.117867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:50.119604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:50.125990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 481/953] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:50.132315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:50.251965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71a51-4e2d-4a35-9c90-b51fde6ae48a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:50.283435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:50.289924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45c06-c1ab-466a-ab1b-9364f6969d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:50.291166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45c06-c1ab-466a-ab1b-9364f6969d83 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:50.291524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45c06-c1ab-466a-ab1b-9364f6969d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:50.292076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45c06-c1ab-466a-ab1b-9364f6969d83 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:50.292840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45c06-c1ab-466a-ab1b-9364f6969d83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:50.293221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45c06-c1ab-466a-ab1b-9364f6969d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:50.294720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45c06-c1ab-466a-ab1b-9364f6969d83 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:50.301056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 473/954] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:50.307070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:50.376977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:50.418582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da092-70d3-42dc-bd70-1c1f0602c940 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:50.454009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a1cd2-d1e7-445a-9bbe-0994526e6591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:50.454740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1cd2-d1e7-445a-9bbe-0994526e6591 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:50.455169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1cd2-d1e7-445a-9bbe-0994526e6591 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:50.455684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1cd2-d1e7-445a-9bbe-0994526e6591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:50.456706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a1cd2-d1e7-445a-9bbe-0994526e6591 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:50.458945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a1cd2-d1e7-445a-9bbe-0994526e6591 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:50.482417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 482/955] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:05:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:51.276047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42b15-8744-4ea4-8182-959f0b136421 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:51.276626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42b15-8744-4ea4-8182-959f0b136421 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:51.276626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42b15-8744-4ea4-8182-959f0b136421 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:51.278254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 474/956] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:51.283836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6455e-3044-41f7-bda1-29b1e03f7679 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:51.284238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6455e-3044-41f7-bda1-29b1e03f7679 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:51.284422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6455e-3044-41f7-bda1-29b1e03f7679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:51.303586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-81b6455e-3044-41f7-bda1-29b1e03f7679 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:51.304780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-81b6455e-3044-41f7-bda1-29b1e03f7679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:51.381201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 483/957] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:51.405358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc42b15-8744-4ea4-8182-959f0b136421 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:51.509852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc42b15-8744-4ea4-8182-959f0b136421 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:51.544425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:51.544965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:51.545246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:51.545520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:51.546204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:51.547837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:51.550376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING keystone.server.flask.common [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 04:05:51.565798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.sql.core [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 04:05:51.565798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 04:05:51.565798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [parameters: {'user_id': '0005bef6a4214bf88511bb8b7b15d0ae', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 04:05:51.565798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application conn.query(q) Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result.read() Jul 27 04:05:51.584260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 04:05:51.585233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application next(self.gen) Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application yield resource Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application next(self.gen) Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise self.value Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application session.commit() Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 04:05:51.586244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.session.flush() Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application compat.raise_( Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 04:05:51.587170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 04:05:51.588235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application conn.query(q) Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application result.read() Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 04:05:51.589105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [parameters: {'user_id': '0005bef6a4214bf88511bb8b7b15d0ae', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:51.589964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 04:05:51.590796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 04:05:51.595973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 04:05:51.595973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 04:05:51.595973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 04:05:51.595973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 04:05:51.595973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 04:05:51.595973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:51.595973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 475/958] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 04:05:51 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:51.596399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6455e-3044-41f7-bda1-29b1e03f7679 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:51.643963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:51.704911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6455e-3044-41f7-bda1-29b1e03f7679 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:51.751945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f469-6f8e-4c4c-94b1-af15db287b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:51.752829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f469-6f8e-4c4c-94b1-af15db287b64 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:51.753263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f469-6f8e-4c4c-94b1-af15db287b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:51.753705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f469-6f8e-4c4c-94b1-af15db287b64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:51.762219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f469-6f8e-4c4c-94b1-af15db287b64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:51.764029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f469-6f8e-4c4c-94b1-af15db287b64 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8617f469-6f8e-4c4c-94b1-af15db287b64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:51.776713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:51.777865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 04:05:51.779126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:51.785748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 484/959] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:05:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:51.788423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:51.850743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:51.895751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638fc1c-8435-473b-bde0-19df5abce3d3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:51.931698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12699724-8388-479b-a062-a429f9d6df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:51.932571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699724-8388-479b-a062-a429f9d6df99 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:51.933026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699724-8388-479b-a062-a429f9d6df99 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:51.933458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699724-8388-479b-a062-a429f9d6df99 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:51.934376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699724-8388-479b-a062-a429f9d6df99 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:51.934830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699724-8388-479b-a062-a429f9d6df99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:51.936649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699724-8388-479b-a062-a429f9d6df99 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:51.983434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 476/960] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 04:05:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:52.075286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969c41-88ac-4e09-82d5-c13ffbc1050d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.075604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969c41-88ac-4e09-82d5-c13ffbc1050d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.075840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969c41-88ac-4e09-82d5-c13ffbc1050d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.077341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 485/961] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:52.082984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1348c0-8173-4a23-8f6b-cd31d0a40a00 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.083694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1348c0-8173-4a23-8f6b-cd31d0a40a00 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.084210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1348c0-8173-4a23-8f6b-cd31d0a40a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.104896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ff1348c0-8173-4a23-8f6b-cd31d0a40a00 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:52.106794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ff1348c0-8173-4a23-8f6b-cd31d0a40a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:52.181121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 477/962] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:52.203536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc969c41-88ac-4e09-82d5-c13ffbc1050d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.245058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e3403-d4b3-4ac6-8177-65c18f71278b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.245654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e3403-d4b3-4ac6-8177-65c18f71278b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.246157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e3403-d4b3-4ac6-8177-65c18f71278b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.247943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 478/963] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:05:52.256870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411204f-65fa-4f4a-9787-7bf8d0900f7c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.256870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411204f-65fa-4f4a-9787-7bf8d0900f7c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.257151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411204f-65fa-4f4a-9787-7bf8d0900f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.276870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9411204f-65fa-4f4a-9787-7bf8d0900f7c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:52.278147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9411204f-65fa-4f4a-9787-7bf8d0900f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:52.322563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:52.323694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc969c41-88ac-4e09-82d5-c13ffbc1050d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:52.331295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:52.349353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 479/964] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:52.360782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:52.361358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.361635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.361908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.362532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:52.363932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:52.373854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411204f-65fa-4f4a-9787-7bf8d0900f7c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:52.374105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:52.375190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:52.376336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 486/965] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:52.381750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.487687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411204f-65fa-4f4a-9787-7bf8d0900f7c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:52.498865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9282-a5ad-4063-aa15-72c174b70d40 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:52.526504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:52.528087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.528525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.529229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.534644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:52.535297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.535574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.535855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.536816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:52.537134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:52.538520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:52.542219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:05:52.543660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 487/966] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:05:52.547154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:52.548437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:05:52.549601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:52.550281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.551578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 480/967] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:52.554877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.587939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:52.590957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:52.659543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfc2d-1eea-4983-ab86-f60ea2daf7a6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:52.660926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1b12-9f47-460a-b296-f4e817e214f2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:52.692034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8402b-46e2-47f4-beaf-54c0ae252061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:52.693246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8402b-46e2-47f4-beaf-54c0ae252061 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.693661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8402b-46e2-47f4-beaf-54c0ae252061 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.693938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8402b-46e2-47f4-beaf-54c0ae252061 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.694607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8402b-46e2-47f4-beaf-54c0ae252061 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:52.694910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8402b-46e2-47f4-beaf-54c0ae252061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:52.695001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:52.695594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.695882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.696160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.696310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8402b-46e2-47f4-beaf-54c0ae252061 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:52.696877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:52.697186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:52.698539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:52.700692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 488/968] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:52.701840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda65c6-a9bf-455d-9edf-bb750e785716 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.702123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda65c6-a9bf-455d-9edf-bb750e785716 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.702398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda65c6-a9bf-455d-9edf-bb750e785716 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.703644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 489/969] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:52.713907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef713f2-ed22-4756-9047-abb699c7cd90 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.714105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 481/970] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:52.714208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef713f2-ed22-4756-9047-abb699c7cd90 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.714208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef713f2-ed22-4756-9047-abb699c7cd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.715276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.730929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4ef713f2-ed22-4756-9047-abb699c7cd90 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:52.732182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4ef713f2-ed22-4756-9047-abb699c7cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:52.810220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 490/971] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:52.827824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:52.832921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c4742-bcfa-448f-9def-a2e9687da2c2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:52.834313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef713f2-ed22-4756-9047-abb699c7cd90 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.864246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:52.876911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:52.877563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.877848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.878127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.891242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:52.892787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:52.909119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:52.910111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:52.911051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:52.911051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:52.911051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:52.911051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:52.911051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 482/972] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:52.916062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:52.947785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef713f2-ed22-4756-9047-abb699c7cd90 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:52.985705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:52.986349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:52.986978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:52.986978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:52.987564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:52.988944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:52.998984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:53.000230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:53.001115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 491/973] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:53.006422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.024796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46254358-5b75-4160-ae5a-06a94410e83c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.061378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.062006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.062290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.062570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.063282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:53.063597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.064965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.077482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 483/974] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:53.083895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.096629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:53.106705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:53.118209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce0f7-1a64-4c60-820d-b16660afafc4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.156782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.157715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.157715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.157986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.158622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:53.158941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.160436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.166713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 492/975] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:53.172308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.205855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5292a1-066c-44a2-bd6c-b6bf5022156c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.243201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.243887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.244178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.244433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.251771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.253211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:05:53.265691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:53.266662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:53.267770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 484/976] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:05:53.273316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.281844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e49e-c605-4364-bfe3-12e21e07ef22 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.319113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.319770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.320050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.320328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.321004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:53.321311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.322693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.328169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 493/977] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:53.334275 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.353923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:53.357825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:53.392403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962c78-b309-44a1-927a-178628fefeb7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.428449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.429033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.429261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.429536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.430325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:53.430631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.432127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.446229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6e04a-0c56-4acd-bffe-14759dcf412c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.452497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 485/978] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:53.458915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.486505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.487287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.487575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.487846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.488602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] RBAC: Adding query filter params (interface=admin, service_id=1033bd014ff24de08f88c95ef8340410, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:53.488913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.490494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.500051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 494/979] 10.222.0.48 () {56 vars in 1249 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/endpoints?service_id=1033bd014ff24de08f88c95ef8340410&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:53.501026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.576876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5486b-e790-46c3-9ef5-7e85f34c24bb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.590366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:53.605545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:53.609933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2c34c-2be2-49aa-a762-2b5d0bde6723 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.615406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.616031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.616311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.616582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.645690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.646301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.646587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.647210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.647807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.648988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.656100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 495/980] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:05:53.693249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.694632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.812041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 486/981] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 04:05:53.818662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:53.924876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cf106-b01b-45d0-9fbf-72652b3d8358 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:53.959494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:53.960109 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:53.960414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:53.960692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:53.972025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:53.973489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:53.983763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:05:53.992383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:53.993586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:53.994717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:05:53.994717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:05:53.994717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:05:53.994717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:53.996909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 496/982] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:54.002125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:54.031376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:54.105920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737bdd-7de9-4dc1-8503-9909e5eabca4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:54.140732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:54.141351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:54.141636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:54.141913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:54.142603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:54.142908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:54.144297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:54.155936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 487/983] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:54.162348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:54.267337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5272-8e8a-4943-8ecf-2d5d4c7c4034 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:54.301049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:54.301721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:54.301993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:54.302268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:54.309061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:54.310524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:05:54.322496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:54.327438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:54.328728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 497/984] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:54.331548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:54.424394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:54.439934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c69a-e987-4779-8a73-65b7446cb687 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:54.474823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ac2ed-9f4d-48d3-b8cf-42ad48fd1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:54.475476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac2ed-9f4d-48d3-b8cf-42ad48fd1da2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:54.475765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac2ed-9f4d-48d3-b8cf-42ad48fd1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:54.476045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac2ed-9f4d-48d3-b8cf-42ad48fd1da2 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:54.476796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ac2ed-9f4d-48d3-b8cf-42ad48fd1da2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:54.477108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ac2ed-9f4d-48d3-b8cf-42ad48fd1da2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:54.478535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ac2ed-9f4d-48d3-b8cf-42ad48fd1da2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:54.491519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 488/985] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:54.497329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:54.558581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:54.601102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9105a-e672-432a-b0b0-0dbc94db8c74 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:54.635742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ceca2-f857-45d8-95fc-e3ee77ff388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:54.636359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceca2-f857-45d8-95fc-e3ee77ff388f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:54.636643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceca2-f857-45d8-95fc-e3ee77ff388f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:54.636917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceca2-f857-45d8-95fc-e3ee77ff388f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:54.637699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ceca2-f857-45d8-95fc-e3ee77ff388f None admin] RBAC: Adding query filter params (role.id=541aaf73a5b241ff94e7416ccfff8606, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a3d53b503346487fa4d707623ab4cec2) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:54.638013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ceca2-f857-45d8-95fc-e3ee77ff388f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:54.639464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ceca2-f857-45d8-95fc-e3ee77ff388f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:54.646045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 498/986] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:05:54 2022] GET /identity/v3/role_assignments?user.id=a3d53b503346487fa4d707623ab4cec2&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=541aaf73a5b241ff94e7416ccfff8606 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:54.748971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb421b-2a1e-4b13-a35e-43117580e233 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:54.749257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb421b-2a1e-4b13-a35e-43117580e233 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:54.749526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb421b-2a1e-4b13-a35e-43117580e233 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:54.751059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 489/987] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:54.757321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4364-2e7a-42b8-a7de-1249e992ddc4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:54.757632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4364-2e7a-42b8-a7de-1249e992ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:54.757881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4364-2e7a-42b8-a7de-1249e992ddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:54.778997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d60c4364-2e7a-42b8-a7de-1249e992ddc4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:54.780284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d60c4364-2e7a-42b8-a7de-1249e992ddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:54.855699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 499/988] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:05:54.877780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb421b-2a1e-4b13-a35e-43117580e233 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:54.985933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb421b-2a1e-4b13-a35e-43117580e233 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:55.021635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e817eb3-a7aa-407f-a398-6e4f3be5664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:55.022255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817eb3-a7aa-407f-a398-6e4f3be5664c None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:55.022533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817eb3-a7aa-407f-a398-6e4f3be5664c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:55.022805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817eb3-a7aa-407f-a398-6e4f3be5664c None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:55.023514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e817eb3-a7aa-407f-a398-6e4f3be5664c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:55.024861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e817eb3-a7aa-407f-a398-6e4f3be5664c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:55.041222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 490/989] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:54 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:55.685042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a454d-56f1-4228-8cb7-87d65bd7aedd None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:55.685573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a454d-56f1-4228-8cb7-87d65bd7aedd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:55.685573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a454d-56f1-4228-8cb7-87d65bd7aedd None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:55.687102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 500/990] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:55.691991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1697-1835-48c3-baed-3619a7a5f246 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:55.692417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1697-1835-48c3-baed-3619a7a5f246 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:55.692760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1697-1835-48c3-baed-3619a7a5f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:55.710691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1b4d1697-1835-48c3-baed-3619a7a5f246 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:55.711888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1b4d1697-1835-48c3-baed-3619a7a5f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:55.713859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:55.798141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 491/991] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:55.821508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a454d-56f1-4228-8cb7-87d65bd7aedd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:55.878338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:55.925134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a454d-56f1-4228-8cb7-87d65bd7aedd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:55.958390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:55.958972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:55.959254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:55.959557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:55.960176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:55.961573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:55.970370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:55.971414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 04:05:55.972259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:55.975610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 501/992] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 04:05:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:55.978194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d1697-1835-48c3-baed-3619a7a5f246 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:56.075773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d1697-1835-48c3-baed-3619a7a5f246 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:56.115049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:56.115701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:56.115979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:56.116247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:56.116925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:56.117226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:56.118580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:56.120300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:56.129913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 492/993] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:56.131305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:56.236564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bbe74-6e2a-4bb9-b907-4eea4330b078 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:56.253312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:56.272017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bd88a-e3ba-40bd-89ca-28ed8f2d6eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:56.272636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd88a-e3ba-40bd-89ca-28ed8f2d6eee None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:56.272919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd88a-e3ba-40bd-89ca-28ed8f2d6eee None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:56.273189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd88a-e3ba-40bd-89ca-28ed8f2d6eee None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:56.273871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bd88a-e3ba-40bd-89ca-28ed8f2d6eee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:56.274176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bd88a-e3ba-40bd-89ca-28ed8f2d6eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:56.275568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bd88a-e3ba-40bd-89ca-28ed8f2d6eee None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:56.285201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 502/994] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 04:05:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:56.286233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:56.388169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439a7b2-cd39-44c7-bfb1-db81b77f6f8d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:56.422096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808a1f1-78f3-4c08-96b4-8403e16a19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:56.422713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808a1f1-78f3-4c08-96b4-8403e16a19e7 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:56.422993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808a1f1-78f3-4c08-96b4-8403e16a19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:56.423294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808a1f1-78f3-4c08-96b4-8403e16a19e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:56.423987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808a1f1-78f3-4c08-96b4-8403e16a19e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:56.425343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808a1f1-78f3-4c08-96b4-8403e16a19e7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:56.445917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 493/995] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:05:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:56.711173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464dd5b-6750-43cf-97a4-40129596e3a9 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:56.711757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464dd5b-6750-43cf-97a4-40129596e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:56.711757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464dd5b-6750-43cf-97a4-40129596e3a9 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:56.713216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 503/996] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:56.718547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f763c9-0b72-4d64-acd8-48ee62df7831 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:56.718957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f763c9-0b72-4d64-acd8-48ee62df7831 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:56.719120 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f763c9-0b72-4d64-acd8-48ee62df7831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:56.742720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-02f763c9-0b72-4d64-acd8-48ee62df7831 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:56.742720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-02f763c9-0b72-4d64-acd8-48ee62df7831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:56.799059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:56.822538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 494/997] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:56 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:56.843763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464dd5b-6750-43cf-97a4-40129596e3a9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:56.962105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464dd5b-6750-43cf-97a4-40129596e3a9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:56.999017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac57dc0-137b-46f5-b298-a78148cd13b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:57.000070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57dc0-137b-46f5-b298-a78148cd13b4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.000562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57dc0-137b-46f5-b298-a78148cd13b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.001042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57dc0-137b-46f5-b298-a78148cd13b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.001890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac57dc0-137b-46f5-b298-a78148cd13b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:57.003587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac57dc0-137b-46f5-b298-a78148cd13b4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2ac57dc0-137b-46f5-b298-a78148cd13b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:57.014330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:57.015422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:05:57.016389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:05:57.019283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 504/998] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jul 27 04:05:56 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:57.028527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f763c9-0b72-4d64-acd8-48ee62df7831 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:57.065835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e42f03-8ec2-4213-aa59-e33b5f91f802 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.066711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e42f03-8ec2-4213-aa59-e33b5f91f802 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.067002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e42f03-8ec2-4213-aa59-e33b5f91f802 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.072966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 505/999] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:57.074183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca96a1-8226-4944-96bc-ede63d08dbcf None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.074467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca96a1-8226-4944-96bc-ede63d08dbcf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.074738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca96a1-8226-4944-96bc-ede63d08dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.093674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6fca96a1-8226-4944-96bc-ede63d08dbcf None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:57.094859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6fca96a1-8226-4944-96bc-ede63d08dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:57.147462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:57.149049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f763c9-0b72-4d64-acd8-48ee62df7831 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:57.182426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 506/1000] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:57.191085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:57.191872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.192356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.192910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.193712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:57.194122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:57.195644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:57.201313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 495/1001] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:57.208706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca96a1-8226-4944-96bc-ede63d08dbcf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:57.208845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:57.278227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:57.327689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca96a1-8226-4944-96bc-ede63d08dbcf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:57.333481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286acb91-1b63-4e2e-9e34-d1daf1bde1a6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:57.363192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:57.364728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.365024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.365577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.366371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:57.366794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:57.368518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:57.369545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:57.370183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.370464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.370747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.371398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:57.372745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:57.374119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 507/1002] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:05:57.381987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:05:57.383125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:05:57.384299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 496/1003] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:05:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:05:57.391658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:57.439824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:57.503974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37c31-ad74-4f7f-ab91-aa419527b6f4 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:57.544142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:57.544670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.544946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.545216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.545893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] RBAC: Adding query filter params (name=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:57.546196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:57.547588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:57.553358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 508/1004] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:57.558782 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:57.662175 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9639b-e34d-4953-a385-cf4901d89801 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:57.675064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:57.698574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:57.699187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.699493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.699764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.700427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:57.700726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:57.702070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:57.707072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 497/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:05:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:57.713433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:57.819560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b60d6-edc4-4def-a96a-6c5fb91e6cda None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:57.821817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:57.856780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82820b2b-c522-4758-87cf-546595d21257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:57.857400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820b2b-c522-4758-87cf-546595d21257 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:57.857682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820b2b-c522-4758-87cf-546595d21257 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:57.857959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82820b2b-c522-4758-87cf-546595d21257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:57.858708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82820b2b-c522-4758-87cf-546595d21257 None admin] RBAC: Adding query filter params (interface=public, service_id=fc0bc574924548ec9fab9a7017dfa6db, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:05:57.859020 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82820b2b-c522-4758-87cf-546595d21257 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:57.860438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82820b2b-c522-4758-87cf-546595d21257 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:57.869885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 509/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:05:57 2022] GET /identity/v3/endpoints?service_id=fc0bc574924548ec9fab9a7017dfa6db&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:05:57.871231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:57.974635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34d00f-d8c0-4fbf-a431-0e9bb1496d50 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:58.010189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942b449-dce8-4e86-be52-acceaa274803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:58.010805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b449-dce8-4e86-be52-acceaa274803 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:58.011085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b449-dce8-4e86-be52-acceaa274803 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:58.011386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b449-dce8-4e86-be52-acceaa274803 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:58.012034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942b449-dce8-4e86-be52-acceaa274803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:58.013500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942b449-dce8-4e86-be52-acceaa274803 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:58.020172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 498/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:05:57 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:05:58.505927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15a75-da28-47c5-a39f-7c49de867811 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:58.506258 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15a75-da28-47c5-a39f-7c49de867811 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:58.506495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15a75-da28-47c5-a39f-7c49de867811 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:58.507966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 510/1008] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:58.513335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89934fd8-8d89-4e75-aa46-0e723dee5155 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:58.513692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89934fd8-8d89-4e75-aa46-0e723dee5155 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:58.514046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89934fd8-8d89-4e75-aa46-0e723dee5155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:58.532976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-89934fd8-8d89-4e75-aa46-0e723dee5155 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:58.534163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89934fd8-8d89-4e75-aa46-0e723dee5155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:58.570342 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:58.604732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 499/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:58.627531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15a75-da28-47c5-a39f-7c49de867811 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:58.735541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15a75-da28-47c5-a39f-7c49de867811 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:58.771981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43bea1-f3a4-4c76-a2a1-d6575c66bdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:58.772626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43bea1-f3a4-4c76-a2a1-d6575c66bdca None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:58.772908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43bea1-f3a4-4c76-a2a1-d6575c66bdca None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:58.773182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43bea1-f3a4-4c76-a2a1-d6575c66bdca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:58.774309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43bea1-f3a4-4c76-a2a1-d6575c66bdca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:58.775784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43bea1-f3a4-4c76-a2a1-d6575c66bdca None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:58.782127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 511/1010] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:05:58.783361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89934fd8-8d89-4e75-aa46-0e723dee5155 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:58.883352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89934fd8-8d89-4e75-aa46-0e723dee5155 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:58.917034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3187-f701-4ebd-a231-aaf8820386ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:58.917642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3187-f701-4ebd-a231-aaf8820386ee None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:58.917925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3187-f701-4ebd-a231-aaf8820386ee None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:58.918199 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3187-f701-4ebd-a231-aaf8820386ee None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:58.918871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b3187-f701-4ebd-a231-aaf8820386ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:58.920327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b3187-f701-4ebd-a231-aaf8820386ee None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:58.948580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 500/1011] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:58 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:05:59.421847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4cb00-9f3f-4c7a-8441-d10b2782cfad None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:59.422247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4cb00-9f3f-4c7a-8441-d10b2782cfad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:59.422424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4cb00-9f3f-4c7a-8441-d10b2782cfad None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:59.423811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 512/1012] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:05:59.429559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34c9a-9bfb-46ac-8e34-928d5d5b65f1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:59.429849 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34c9a-9bfb-46ac-8e34-928d5d5b65f1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:59.430123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34c9a-9bfb-46ac-8e34-928d5d5b65f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:59.449581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cbd34c9a-9bfb-46ac-8e34-928d5d5b65f1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:05:59.450760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cbd34c9a-9bfb-46ac-8e34-928d5d5b65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:05:59.469051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:59.524105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 501/1013] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:05:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:05:59.546288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4cb00-9f3f-4c7a-8441-d10b2782cfad None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:05:59.584379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:05:59.653471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4cb00-9f3f-4c7a-8441-d10b2782cfad None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:05:59.688793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1a9c0-a399-4637-9f42-0534a65cf515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:05:59.689548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a9c0-a399-4637-9f42-0534a65cf515 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:05:59.689826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a9c0-a399-4637-9f42-0534a65cf515 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:05:59.690173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a9c0-a399-4637-9f42-0534a65cf515 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:05:59.690874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1a9c0-a399-4637-9f42-0534a65cf515 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:05:59.693780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1a9c0-a399-4637-9f42-0534a65cf515 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:05:59.718583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 513/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:05:59 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:00.032066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb5fc-8fc7-4fbf-81c9-3447a40dc833 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:00.032589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb5fc-8fc7-4fbf-81c9-3447a40dc833 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:00.032589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb5fc-8fc7-4fbf-81c9-3447a40dc833 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:00.034010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 502/1015] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:00.039678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d6c5-4d84-43dd-b7d9-f270545802e5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:00.040092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d6c5-4d84-43dd-b7d9-f270545802e5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:00.040272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d6c5-4d84-43dd-b7d9-f270545802e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:00.058427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3510d6c5-4d84-43dd-b7d9-f270545802e5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:00.059642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3510d6c5-4d84-43dd-b7d9-f270545802e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:00.138834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 514/1016] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:00 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:00.161276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdb5fc-8fc7-4fbf-81c9-3447a40dc833 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:00.267447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdb5fc-8fc7-4fbf-81c9-3447a40dc833 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:00.302204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:00.302769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:00.303052 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:00.303350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:00.303977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:00.305352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:00.314398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:00.315424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:00.325278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 503/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:06:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:00.326284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d6c5-4d84-43dd-b7d9-f270545802e5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:00.350093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:00.428961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d6c5-4d84-43dd-b7d9-f270545802e5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:00.464138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da071-067e-4313-ae15-8273627a8205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:00.464754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da071-067e-4313-ae15-8273627a8205 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:00.465028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da071-067e-4313-ae15-8273627a8205 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:00.465298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da071-067e-4313-ae15-8273627a8205 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:00.465969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da071-067e-4313-ae15-8273627a8205 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:00.466272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da071-067e-4313-ae15-8273627a8205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:00.467656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da071-067e-4313-ae15-8273627a8205 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:00.472681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 515/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:06:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:00.478837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:00.498057 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:00.580748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fabe4-6bce-43b7-8fde-89ad0c2d6219 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:00.613375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0b48c-22e4-403d-b2c9-0fa25cd2c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:00.614520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0b48c-22e4-403d-b2c9-0fa25cd2c33f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:00.614917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0b48c-22e4-403d-b2c9-0fa25cd2c33f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:00.615198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0b48c-22e4-403d-b2c9-0fa25cd2c33f None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:00.615897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0b48c-22e4-403d-b2c9-0fa25cd2c33f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:00.616201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0b48c-22e4-403d-b2c9-0fa25cd2c33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:00.617554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0b48c-22e4-403d-b2c9-0fa25cd2c33f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:00.622528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 504/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 04:06:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:00.628114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da071-067e-4313-ae15-8273627a8205 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:00.717034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:00.736435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da071-067e-4313-ae15-8273627a8205 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:00.777667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df684a16-2cff-4ab5-afdc-a1f7a5f17572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:00.778298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684a16-2cff-4ab5-afdc-a1f7a5f17572 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:00.778582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684a16-2cff-4ab5-afdc-a1f7a5f17572 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:00.778859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684a16-2cff-4ab5-afdc-a1f7a5f17572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:00.779611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df684a16-2cff-4ab5-afdc-a1f7a5f17572 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:00.780988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df684a16-2cff-4ab5-afdc-a1f7a5f17572 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:00.802727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 516/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:06:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:01.039969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8963bd-c448-4430-9002-7e0772725b95 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:01.040516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8963bd-c448-4430-9002-7e0772725b95 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:01.040516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8963bd-c448-4430-9002-7e0772725b95 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:01.041892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 505/1021] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:01.047203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821788-fe1f-47cd-9630-9e8fb2f8c59f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:01.047631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821788-fe1f-47cd-9630-9e8fb2f8c59f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:01.047818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821788-fe1f-47cd-9630-9e8fb2f8c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:01.067004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-22821788-fe1f-47cd-9630-9e8fb2f8c59f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:01.069200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-22821788-fe1f-47cd-9630-9e8fb2f8c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:01.151295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 517/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:01.172291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8963bd-c448-4430-9002-7e0772725b95 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:01.263014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:01.285673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8963bd-c448-4430-9002-7e0772725b95 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:01.321758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432992f8-8c10-426a-8f20-6ecabec734dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:01.322322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432992f8-8c10-426a-8f20-6ecabec734dc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:01.322602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432992f8-8c10-426a-8f20-6ecabec734dc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:01.322924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432992f8-8c10-426a-8f20-6ecabec734dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:01.324099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432992f8-8c10-426a-8f20-6ecabec734dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:01.325520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432992f8-8c10-426a-8f20-6ecabec734dc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:01.327301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 506/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:01.333296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821788-fe1f-47cd-9630-9e8fb2f8c59f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:01.406590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:01.442886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821788-fe1f-47cd-9630-9e8fb2f8c59f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:01.478548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3716-16d7-40ad-9923-4d62777ac1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:01.479135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3716-16d7-40ad-9923-4d62777ac1e9 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:01.479436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3716-16d7-40ad-9923-4d62777ac1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:01.479703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3716-16d7-40ad-9923-4d62777ac1e9 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:01.480497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a3716-16d7-40ad-9923-4d62777ac1e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:01.481833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a3716-16d7-40ad-9923-4d62777ac1e9 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:01.511286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 518/1024] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:06:01 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:01.745112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4e0f-8ef3-4f90-b243-3888b8d43793 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:01.745112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4e0f-8ef3-4f90-b243-3888b8d43793 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:01.745290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4e0f-8ef3-4f90-b243-3888b8d43793 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:01.746526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 507/1025] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:01.751863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24ca4-d2bc-4ada-befd-8f369987b675 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:01.752155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24ca4-d2bc-4ada-befd-8f369987b675 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:01.752435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24ca4-d2bc-4ada-befd-8f369987b675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:01.771901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d9d24ca4-d2bc-4ada-befd-8f369987b675 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:01.773094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d9d24ca4-d2bc-4ada-befd-8f369987b675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:01.840841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 519/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:01.862755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4e0f-8ef3-4f90-b243-3888b8d43793 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:01.966259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4e0f-8ef3-4f90-b243-3888b8d43793 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:02.001331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:02.001896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:02.002176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:02.002497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] PATH_INFO: `/v3/services/image` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:02.003121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:02.004516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:02.014769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:02.016091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:02.016984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 508/1027] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jul 27 04:06:01 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:02.022543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d24ca4-d2bc-4ada-befd-8f369987b675 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:02.079823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:02.126308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d24ca4-d2bc-4ada-befd-8f369987b675 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:02.159940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:02.160557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:02.161455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:02.161730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:02.162576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] RBAC: Adding query filter params (name=image) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:02.162881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:02.164287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:02.169167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 520/1028] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:02.175124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:02.191111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:02.279267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b672f42-1a92-4bd4-b3b4-03f45f1b7d7f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:02.312779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:02.313395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:02.313677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:02.313951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:02.314620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] RBAC: Adding query filter params (type=image) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:02.314924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:02.316310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:02.326581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 509/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:02.328324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:02.430135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687f3b-3174-4fd6-b6b1-3b5cd35761bb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:02.448172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:02.466176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf177841-9afd-42dd-b80f-d9d312024794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:02.466792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf177841-9afd-42dd-b80f-d9d312024794 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:02.467072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf177841-9afd-42dd-b80f-d9d312024794 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:02.467371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf177841-9afd-42dd-b80f-d9d312024794 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:02.468149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf177841-9afd-42dd-b80f-d9d312024794 None admin] RBAC: Adding query filter params (interface=public, service_id=6df2fa26d2a24829bfb1c5126ce6529d, region_id=RegionOne) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:02.468459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf177841-9afd-42dd-b80f-d9d312024794 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:02.469826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf177841-9afd-42dd-b80f-d9d312024794 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:02.479580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 521/1030] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:06:02 2022] GET /identity/v3/endpoints?service_id=6df2fa26d2a24829bfb1c5126ce6529d&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:02.481158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:02.561511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:02.585934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62674a9-41bf-4f86-b6a7-5c9cbdb4518a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:02.619113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff264d6d-92cb-44ae-82f3-23974ce642f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:02.619765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264d6d-92cb-44ae-82f3-23974ce642f3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:02.620045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264d6d-92cb-44ae-82f3-23974ce642f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:02.620316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264d6d-92cb-44ae-82f3-23974ce642f3 None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:02.620964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff264d6d-92cb-44ae-82f3-23974ce642f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:02.622318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff264d6d-92cb-44ae-82f3-23974ce642f3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:02.635298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 510/1031] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:06:02 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:06:02.936098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0c9c-85b3-42c1-9111-1523dcb3ae54 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:02.936399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0c9c-85b3-42c1-9111-1523dcb3ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:02.936594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0c9c-85b3-42c1-9111-1523dcb3ae54 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:02.938071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 522/1032] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:02.943609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dc386-9519-40d2-87dc-8008a604292e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:02.943903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dc386-9519-40d2-87dc-8008a604292e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:02.944182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dc386-9519-40d2-87dc-8008a604292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:02.962051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2b5dc386-9519-40d2-87dc-8008a604292e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:02.963247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2b5dc386-9519-40d2-87dc-8008a604292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:03.031420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 511/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:03.055156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0c9c-85b3-42c1-9111-1523dcb3ae54 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.158497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0c9c-85b3-42c1-9111-1523dcb3ae54 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:03.197610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:03.198180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.198473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.198738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.209914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:03.215882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:03.216826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:06:03.217704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:03.218973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 523/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:03.226748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dc386-9519-40d2-87dc-8008a604292e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.296660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:03.328834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dc386-9519-40d2-87dc-8008a604292e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:03.363351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:03.364012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.364297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.364608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.365284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:03.365591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:03.366967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:03.375255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 512/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:03.381390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.428112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:03.488712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08611-1d68-4238-994c-20f02f95dbed None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:03.523989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18556b9-c5b9-4e8d-b550-6576e880529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:03.524625 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18556b9-c5b9-4e8d-b550-6576e880529a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.524948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18556b9-c5b9-4e8d-b550-6576e880529a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.525223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18556b9-c5b9-4e8d-b550-6576e880529a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.535513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18556b9-c5b9-4e8d-b550-6576e880529a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:03.538115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18556b9-c5b9-4e8d-b550-6576e880529a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e18556b9-c5b9-4e8d-b550-6576e880529a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:03.553869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:03.554800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:03.555763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:06:03.555763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:03.555763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:03.555763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:03.555763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 524/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:06:03.562034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.576247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e75f-c87f-49dd-b804-74cbe77fd7ed None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.576538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e75f-c87f-49dd-b804-74cbe77fd7ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.576819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e75f-c87f-49dd-b804-74cbe77fd7ed None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.578313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 525/1037] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:03.583799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45c6e-2ff3-43cf-9246-3c798536e122 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.583799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45c6e-2ff3-43cf-9246-3c798536e122 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.584140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45c6e-2ff3-43cf-9246-3c798536e122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.602325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f6c45c6e-2ff3-43cf-9246-3c798536e122 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:03.603556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f6c45c6e-2ff3-43cf-9246-3c798536e122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:03.674302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5625d-054c-4251-9f96-28e074492edb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:03.680046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 526/1038] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:06:03.698672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c45c6e-2ff3-43cf-9246-3c798536e122 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.709341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:03.715176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:03.715824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.716104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.716373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.717053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:03.717354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:03.718698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:03.731606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:03.740526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 513/1039] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:03.741838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.819178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c45c6e-2ff3-43cf-9246-3c798536e122 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:03.853636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72533d9-586f-401d-b556-9ad4aeb2c696 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:03.857382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:03.858033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.858315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.858591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.869651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:03.874473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:03.875481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:03.876350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 527/1040] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:06:03.882369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.892545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:03.893234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:03.893839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:03.894115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:03.902455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:03.903972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:06:03.919233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:03.920237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:03.925908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 514/1041] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:06:03.926656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:03.977048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:03.981539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.001199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8029-fca8-4cd4-98b4-55d9b4b3499b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.032778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899d00-8282-4648-92fa-d2884befb8c4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.039818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.040439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.040718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.040995 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.041704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:04.042032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.043440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.052361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 528/1042] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:04.057421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.072393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.073413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.073915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.074456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.075463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:04.075967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.077811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.097838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 515/1043] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:06:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:04.103179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.169036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f44e0c-8ee2-4f3d-8f1b-6f21551efa1f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.205731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.206363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.206645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.206920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] PATH_INFO: `/v3/users/197a4110c25c4685acfe0921d60a5302` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.209258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dde92e-435b-4fee-9b52-ed69ef4fca82 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.220589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.221049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] RBAC: Authorizing `identity:get_user(user_id=197a4110c25c4685acfe0921d60a5302)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.222975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.226876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 529/1044] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/users/197a4110c25c4685acfe0921d60a5302 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:04.231932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.238095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.249823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.250806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.250806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.251011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.327876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.329331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.340426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947b71-3205-4ed6-9444-815c8904f5ee None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.377462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.378080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.378652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.379042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.444027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 516/1045] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 04:06:04.449702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.457013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.458728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.462256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.462628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.551363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15f9b9-e0ea-4f19-a870-9e1e5b2dcd15 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.573720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 530/1046] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 04:06:04.579157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.588529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.589171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.589450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.589722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.601288 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.602733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:04.618554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:04.619559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:04.625193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:06:04.625193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:04.625193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:04.625193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:04.625193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 517/1047] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:04.625193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.688586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c39e6-30e4-468a-8d1d-72e1862c7ac2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.690790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.691839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.727423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98015cbb-5fc4-456d-8900-8294d57ac0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.728190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015cbb-5fc4-456d-8900-8294d57ac0bf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.728474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015cbb-5fc4-456d-8900-8294d57ac0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.728748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015cbb-5fc4-456d-8900-8294d57ac0bf None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.729902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98015cbb-5fc4-456d-8900-8294d57ac0bf None admin] RBAC: Authorizing `identity:get_project(project_id=298759d135f74149bf8f573445525138)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.730290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1e83-8e7e-46af-9a12-93119f208e2e None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.731381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98015cbb-5fc4-456d-8900-8294d57ac0bf None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.733341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 531/1048] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/projects/298759d135f74149bf8f573445525138 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:04.734313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855a863-8f59-44d6-a6a6-5bbfdcdaa2ea None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.734598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855a863-8f59-44d6-a6a6-5bbfdcdaa2ea None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.734877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855a863-8f59-44d6-a6a6-5bbfdcdaa2ea None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.736226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 532/1049] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:04.739638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855a863-8f59-44d6-a6a6-5bbfdcdaa2ea None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.766485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993449d-07b5-4308-a78e-c57765146d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.767138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993449d-07b5-4308-a78e-c57765146d0b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.767468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993449d-07b5-4308-a78e-c57765146d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.767746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993449d-07b5-4308-a78e-c57765146d0b None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.768435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993449d-07b5-4308-a78e-c57765146d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:04.768742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993449d-07b5-4308-a78e-c57765146d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.770682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993449d-07b5-4308-a78e-c57765146d0b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.782886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 518/1050] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:04.784098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a8ec4-b388-421e-9c8c-0686309dd78c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.784378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a8ec4-b388-421e-9c8c-0686309dd78c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.784647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a8ec4-b388-421e-9c8c-0686309dd78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.801455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-699a8ec4-b388-421e-9c8c-0686309dd78c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:04.802628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-699a8ec4-b388-421e-9c8c-0686309dd78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:04.847757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855a863-8f59-44d6-a6a6-5bbfdcdaa2ea None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:04.868147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 519/1051] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:04.868965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a8ec4-b388-421e-9c8c-0686309dd78c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.884047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:04.884670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:04.884952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:04.885229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:04.886013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=298759d135f74149bf8f573445525138, user.id=197a4110c25c4685acfe0921d60a5302) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:04.886325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:04.887794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:04.893624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 533/1052] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/role_assignments?user.id=197a4110c25c4685acfe0921d60a5302&scope.project.id=298759d135f74149bf8f573445525138&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:04.894515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:04.928622 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.934212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:04.984179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a8ec4-b388-421e-9c8c-0686309dd78c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:05.014292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ae4e-a5e8-4043-b089-4649bc70dea5 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:05.028836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:05.029498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:05.029832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:05.030041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:05.039582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:05.041033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:06:05.053176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:05.054333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:06:05.055516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:05.056225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 520/1053] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:05.059043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:05.060030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:05.060978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:05.061069 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:05.061161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] PATH_INFO: `/v3/services/image` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:05.061161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:05.067383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:05.077024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:05.078331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 04:06:05.079449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:05.080846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 534/1054] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jul 27 04:06:04 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:05.087294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:05.177050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb610c-58ee-48b1-acbd-266e8ae0a2da None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:05.190768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:05.191368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:05.195830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e86b0-52d6-4cb1-98fb-c63c79fdc216 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:05.216696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:05.217320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:05.217602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:05.217877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:05.218620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:05.218928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:05.220388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:05.234693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 521/1055] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:05.236162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:05.236780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:05.237059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:05.237331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:05.238005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:05.238307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:05.239859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:05.241212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:05.250943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 535/1056] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:05.252501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:05.349398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1590fc-443f-4309-9a99-8978a7f5858d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:05.363587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1048b-5cac-406a-bf0a-b4bc092ff8d7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:05.389888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:05.390750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:05.391028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:05.391357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:05.392297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] RBAC: Adding query filter params (role.id=541aaf73a5b241ff94e7416ccfff8606, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a61ebb13ad8c483fa715e5f6906b05f0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:05.392611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:05.394049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:05.399582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 522/1057] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:05 2022] GET /identity/v3/role_assignments?user.id=a61ebb13ad8c483fa715e5f6906b05f0&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=541aaf73a5b241ff94e7416ccfff8606 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:05.400873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a4ffb-086b-48d2-a270-835d55198368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:05.401494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a4ffb-086b-48d2-a270-835d55198368 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:05.401773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a4ffb-086b-48d2-a270-835d55198368 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:05.402045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a4ffb-086b-48d2-a270-835d55198368 None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:05.402727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a4ffb-086b-48d2-a270-835d55198368 None admin] RBAC: Adding query filter params (type=image) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:05.403034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a4ffb-086b-48d2-a270-835d55198368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:05.404473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a4ffb-086b-48d2-a270-835d55198368 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:05.415316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 536/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:05.418695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:05.460840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:05.532932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506f4e-f9cb-4e6a-8622-415d04268de2 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:05.572113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f64b65-2f54-4047-8865-02fca007113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:05.572738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f64b65-2f54-4047-8865-02fca007113f None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:05.573015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f64b65-2f54-4047-8865-02fca007113f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:05.573285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f64b65-2f54-4047-8865-02fca007113f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:05.573998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f64b65-2f54-4047-8865-02fca007113f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:05.575382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f64b65-2f54-4047-8865-02fca007113f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:05.595113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 523/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:06:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:06.906984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfd9c-6709-4c25-a799-c28a60209e40 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:06.907554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfd9c-6709-4c25-a799-c28a60209e40 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:06.907554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfd9c-6709-4c25-a799-c28a60209e40 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:06.909074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 537/1060] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:06.914625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496cb93-d0da-4f7e-abcc-b343b5f16fdd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:06.915016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496cb93-d0da-4f7e-abcc-b343b5f16fdd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:06.915211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496cb93-d0da-4f7e-abcc-b343b5f16fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:06.933716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b496cb93-d0da-4f7e-abcc-b343b5f16fdd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:06.934913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b496cb93-d0da-4f7e-abcc-b343b5f16fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:07.007673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 524/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:07.029714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cfd9c-6709-4c25-a799-c28a60209e40 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.063966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:07.139326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cfd9c-6709-4c25-a799-c28a60209e40 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:07.173750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:07.174401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.174685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.174962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.185694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:07.190651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:07.191654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:07.192548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:07.193958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 538/1062] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:07.198128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496cb93-d0da-4f7e-abcc-b343b5f16fdd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.219167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:07.311160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496cb93-d0da-4f7e-abcc-b343b5f16fdd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:07.345791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa48325-4042-4783-8542-07ab0f154126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:07.346417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa48325-4042-4783-8542-07ab0f154126 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.346702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa48325-4042-4783-8542-07ab0f154126 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.346980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa48325-4042-4783-8542-07ab0f154126 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.347731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa48325-4042-4783-8542-07ab0f154126 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:07.348346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa48325-4042-4783-8542-07ab0f154126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:07.349436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa48325-4042-4783-8542-07ab0f154126 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:07.362425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 525/1063] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:07.364824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.410087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72739707-b92a-4e1d-ba40-0dcff78cb848 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.410443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72739707-b92a-4e1d-ba40-0dcff78cb848 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.410712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72739707-b92a-4e1d-ba40-0dcff78cb848 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.412429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 526/1064] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:06:07.417239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb946-3baa-417d-b606-9d6a782882f3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.417526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb946-3baa-417d-b606-9d6a782882f3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.417803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb946-3baa-417d-b606-9d6a782882f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.437082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-57beb946-3baa-417d-b606-9d6a782882f3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:07.438399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-57beb946-3baa-417d-b606-9d6a782882f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:07.458552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:07.470574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34d333-87c2-4310-ae6c-a8a0b13f9570 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:07.505199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:07.505846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.506129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.506409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] PATH_INFO: `/v3/users/197a4110c25c4685acfe0921d60a5302` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.507612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] RBAC: Authorizing `identity:get_user(user_id=197a4110c25c4685acfe0921d60a5302)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:07.509324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:07.510936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 539/1065] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/users/197a4110c25c4685acfe0921d60a5302 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:07.516967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.519663 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 527/1066] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:06:07.542587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb946-3baa-417d-b606-9d6a782882f3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.554011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:07.628695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff10d6-0cdf-4649-ab4b-dbef3f2a7e0c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:07.641585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb946-3baa-417d-b606-9d6a782882f3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:07.666287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a615f-75c6-4453-851f-3ccdc0a731fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:07.667276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a615f-75c6-4453-851f-3ccdc0a731fd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.667705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a615f-75c6-4453-851f-3ccdc0a731fd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.667986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a615f-75c6-4453-851f-3ccdc0a731fd None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.669145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a615f-75c6-4453-851f-3ccdc0a731fd None admin] RBAC: Authorizing `identity:get_project(project_id=298759d135f74149bf8f573445525138)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:07.670589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a615f-75c6-4453-851f-3ccdc0a731fd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:07.672402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 540/1067] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/projects/298759d135f74149bf8f573445525138 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:07.673389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dad28-5050-4d13-a6c2-c8a17ec3b0d3 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.673674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dad28-5050-4d13-a6c2-c8a17ec3b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.673949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dad28-5050-4d13-a6c2-c8a17ec3b0d3 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.675151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 541/1068] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:07.679014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dad28-5050-4d13-a6c2-c8a17ec3b0d3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.681677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c1347-0fe5-481b-97a2-dceb227ed2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:07.683075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1347-0fe5-481b-97a2-dceb227ed2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.683075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1347-0fe5-481b-97a2-dceb227ed2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.683075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1347-0fe5-481b-97a2-dceb227ed2f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.694118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c1347-0fe5-481b-97a2-dceb227ed2f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-226c1347-0fe5-481b-97a2-dceb227ed2f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:07.698936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:07.700205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:07.701259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 528/1069] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:06:07.702109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7c5f-cb57-48b4-bf61-60c9fbc5b564 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.702109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7c5f-cb57-48b4-bf61-60c9fbc5b564 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.702109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7c5f-cb57-48b4-bf61-60c9fbc5b564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.709437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:07.720284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a57a7c5f-cb57-48b4-bf61-60c9fbc5b564 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:07.721463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a57a7c5f-cb57-48b4-bf61-60c9fbc5b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:07.784519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:07.788147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dad28-5050-4d13-a6c2-c8a17ec3b0d3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:07.789667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 529/1070] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:07.792140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7c5f-cb57-48b4-bf61-60c9fbc5b564 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.824780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:07.825512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.825797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.826107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138/users/197a4110c25c4685acfe0921d60a5302/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.828094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] RBAC: Authorizing `identity:create_grant(project_id=298759d135f74149bf8f573445525138, user_id=197a4110c25c4685acfe0921d60a5302, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:07.829541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:07.842940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 542/1071] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:06:07 2022] PUT /identity/v3/projects/298759d135f74149bf8f573445525138/users/197a4110c25c4685acfe0921d60a5302/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:06:07.843762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.897671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7c5f-cb57-48b4-bf61-60c9fbc5b564 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:07.938872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:07.939626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:07.939855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:07.940084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:07.940787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:07.941094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:07.943095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:07.946672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:07.952537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 530/1072] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:07.958967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:07.975565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19304616-dd95-4974-a43c-2e39d9577701 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.018376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.018993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.019744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.020572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.029827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:08.072156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2357d-8bda-4a8e-8c7c-d444c793a89f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.097515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.099707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.108529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.109170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.109448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.109726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.121536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.122971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:08.138853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:08.139824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:08.140753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:06:08.140753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:08.140753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:08.140753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:08.140753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 531/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:08.146098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:08.197654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:08.219310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 543/1074] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:08.222681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:08.256051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa296-273a-41d2-b3f3-53a79a126595 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.272684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:08.295741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.296366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.296649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.296926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.297616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:08.297923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.299319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.316310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 532/1075] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:08.318865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:08.329660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71657cbd-b1e6-44e2-8a31-bfbf436ca699 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.366543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.367504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.367787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.368062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.380112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.381714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:08.397833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:08.398772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:08.404927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:06:08.404927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:08.404927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:08.404927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:08.404927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 544/1076] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:08.404927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:08.431623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc453f-818f-4905-a11a-104a6d2392fb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.440757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:08.471111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.471785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.472073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.472346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.481208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.483078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:06:08.497088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:08.498119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:06:08.499130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:08.503607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 533/1077] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:06:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:08.504091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:08.511390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be378c-6bfe-431a-92c7-b40a6c526b32 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.542891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:08.548394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.549025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.549300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.549626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.550314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:08.550675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.552159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.564895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 545/1078] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:08.615867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041d06c-c83b-494a-bcc5-9ed968eedff1 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.653107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.653745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.654027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.654302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.655103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:08.655454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.656911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.681076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 534/1079] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:06:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:08.682437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:08.789637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:08.799509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc59e6-092e-4e3f-9699-94eb0b4b5dab None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:08.836661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:08.837311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:08.837590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:08.837864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:08.849457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:08.850936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:08.866864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:08.867840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:08.868799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:06:08.868799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:08.868799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:08.868799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:08.868799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 546/1080] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:08.874001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:08.965057 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:08.974972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a26d61-6132-46b3-820a-435c3f3bd5e0 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:09.008982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:09.009538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:09.009822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:09.010099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:09.010785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:09.011088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:09.012533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:09.024308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 535/1081] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:09.029984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:09.127700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386f87-69ad-4667-b4ee-c67bdd8a4aab None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:09.161345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:09.161970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:09.162248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:09.162518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:09.168985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:09.170414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:06:09.181398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:09.182295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:09.183405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 547/1082] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:09.188283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:09.287236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b9b9-f486-4e98-8ba3-fdb3573d86b8 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:09.320442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bd136-ab3b-4bc7-bed8-9091caa7691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:09.321053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bd136-ab3b-4bc7-bed8-9091caa7691e None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:09.321335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bd136-ab3b-4bc7-bed8-9091caa7691e None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:09.321608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bd136-ab3b-4bc7-bed8-9091caa7691e None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:09.322344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bd136-ab3b-4bc7-bed8-9091caa7691e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:09.322651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bd136-ab3b-4bc7-bed8-9091caa7691e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:09.324102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bd136-ab3b-4bc7-bed8-9091caa7691e None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:09.336356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 536/1083] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:09.342271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:09.353399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:09.440578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599470e6-8687-4975-ba02-36a46d91464c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:09.475657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2aac-1edc-4f6e-8b34-927ad02ef2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:09.476334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2aac-1edc-4f6e-8b34-927ad02ef2e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:09.476629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2aac-1edc-4f6e-8b34-927ad02ef2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:09.476892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2aac-1edc-4f6e-8b34-927ad02ef2e2 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a61ebb13ad8c483fa715e5f6906b05f0/roles/541aaf73a5b241ff94e7416ccfff8606` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:09.479076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2aac-1edc-4f6e-8b34-927ad02ef2e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=a61ebb13ad8c483fa715e5f6906b05f0, role_id=541aaf73a5b241ff94e7416ccfff8606)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:09.480558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2aac-1edc-4f6e-8b34-927ad02ef2e2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:09.494699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 548/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:06:09 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/a61ebb13ad8c483fa715e5f6906b05f0/roles/541aaf73a5b241ff94e7416ccfff8606 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:06:09.879867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52e67-68f9-49eb-8929-40af2b8a11c9 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:09.880151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52e67-68f9-49eb-8929-40af2b8a11c9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:09.880423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52e67-68f9-49eb-8929-40af2b8a11c9 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:09.881780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 537/1085] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:09.887204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6720-cd9d-4a76-8368-615d14951499 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:09.887531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6720-cd9d-4a76-8368-615d14951499 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:09.887815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6720-cd9d-4a76-8368-615d14951499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:09.905782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-517f6720-cd9d-4a76-8368-615d14951499 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:09.906975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-517f6720-cd9d-4a76-8368-615d14951499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:09.968300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:09.975093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 549/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:09.998329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52e67-68f9-49eb-8929-40af2b8a11c9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:10.013789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:10.100296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52e67-68f9-49eb-8929-40af2b8a11c9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:10.133103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:10.133994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:10.134275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:10.134548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:10.144679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:10.154567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:10.155632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:10.156493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 538/1087] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:10.161978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f6720-cd9d-4a76-8368-615d14951499 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:10.265062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f6720-cd9d-4a76-8368-615d14951499 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:10.298186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:10.298787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:10.299066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:10.299361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:10.300063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:10.300363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:10.302723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:10.310711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 550/1088] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:10.316356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:10.387109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:10.416158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade296e8-7358-41fb-a6b2-f53a60c59402 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:10.451346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:10.451976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:10.452254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:10.452525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] PATH_INFO: `/v3/users/197a4110c25c4685acfe0921d60a5302` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:10.453660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=197a4110c25c4685acfe0921d60a5302)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:10.455125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:10.456742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 539/1089] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:10 2022] GET /identity/v3/users/197a4110c25c4685acfe0921d60a5302 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:10.462539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:10.521413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:10.563923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794a665-59f1-411d-99b7-4c327fae4c16 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:10.598969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:10.599638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:10.599917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:10.600193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:10.666958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:10.668453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:10.725817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:10.768035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 551/1090] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 04:06:10.773906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:10.871080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad702-835c-44af-9353-63287178a7d4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:10.904796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca6c0d-0d30-4fc2-b022-4d9027fb3f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:10.905436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca6c0d-0d30-4fc2-b022-4d9027fb3f57 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:10.905719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca6c0d-0d30-4fc2-b022-4d9027fb3f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:10.905996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca6c0d-0d30-4fc2-b022-4d9027fb3f57 None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:10.907142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca6c0d-0d30-4fc2-b022-4d9027fb3f57 None admin] RBAC: Authorizing `identity:get_project(project_id=298759d135f74149bf8f573445525138)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:10.908590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca6c0d-0d30-4fc2-b022-4d9027fb3f57 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:10.910272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 540/1091] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:10 2022] GET /identity/v3/projects/298759d135f74149bf8f573445525138 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:10.917050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:11.013357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9317c-ac81-42aa-be6a-9718290cc3dd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:11.047704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130759b0-9b16-49ca-8748-6fb1c6c1bc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:11.048254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130759b0-9b16-49ca-8748-6fb1c6c1bc99 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:11.048535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130759b0-9b16-49ca-8748-6fb1c6c1bc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:11.048806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130759b0-9b16-49ca-8748-6fb1c6c1bc99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:11.049585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130759b0-9b16-49ca-8748-6fb1c6c1bc99 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=298759d135f74149bf8f573445525138, user.id=197a4110c25c4685acfe0921d60a5302) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:11.049895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130759b0-9b16-49ca-8748-6fb1c6c1bc99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:11.051467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130759b0-9b16-49ca-8748-6fb1c6c1bc99 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:11.057227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 552/1092] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:10 2022] GET /identity/v3/role_assignments?user.id=197a4110c25c4685acfe0921d60a5302&scope.project.id=298759d135f74149bf8f573445525138&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:11.473531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae235f66-ec7c-44ad-910e-8b77a39903c4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:11.474034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae235f66-ec7c-44ad-910e-8b77a39903c4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:11.474034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae235f66-ec7c-44ad-910e-8b77a39903c4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:11.475386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 541/1093] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:11.480603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58a692-dbb1-49c6-ab19-b92cf65341ae None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:11.481010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58a692-dbb1-49c6-ab19-b92cf65341ae None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:11.481283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58a692-dbb1-49c6-ab19-b92cf65341ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:11.499023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5f58a692-dbb1-49c6-ab19-b92cf65341ae None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:11.500230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5f58a692-dbb1-49c6-ab19-b92cf65341ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:11.518525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:11.567961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 553/1094] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:11.591550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae235f66-ec7c-44ad-910e-8b77a39903c4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:11.602863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:11.692780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae235f66-ec7c-44ad-910e-8b77a39903c4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:11.726250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:11.727147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:11.727476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:11.727754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:11.737950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:11.743887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:11.745745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:11.746871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 542/1095] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 04:06:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:11.750996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58a692-dbb1-49c6-ab19-b92cf65341ae None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:11.848372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58a692-dbb1-49c6-ab19-b92cf65341ae None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:11.881966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:11.882576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:11.882854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:11.883125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:11.884108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:11.884411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:11.885775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:11.893442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 554/1096] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 04:06:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:11.899088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:11.963450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:11.995758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94171-2e6c-4c51-8ff2-ba28b1634a35 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:12.028729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:12.029353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:12.029634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:12.029909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:12.040227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:12.041666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:12.056429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:12.057504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:12.063007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:06:12.063007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:12.063007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:12.063007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:12.063007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 543/1097] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:12.063326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:12.081337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:12.163221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b25b-cc3e-4848-bec8-bf75871f9b9c None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:12.196700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:12.197335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:12.197616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:12.197888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:12.198598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:12.198905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:12.200358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:12.214094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 555/1098] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:12.219681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:12.321234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce0fb-32a8-47ba-b5e6-715f523aeeeb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:12.340772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:12.354861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:12.355513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:12.355794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:12.356066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:12.363228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:12.365207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:06:12.376044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:12.377154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:12.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 544/1099] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 04:06:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:12.383857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:12.460851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:12.483473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066797-afb0-4a1d-b231-a86f9582a35e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:12.518555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:12.519171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:12.519497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:12.519833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:12.520891 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:12.521207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:12.522661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:12.540272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 556/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 04:06:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:12.545951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:12.644546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbb2c0-364d-4677-8c1e-1fcba201f542 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:12.677531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:12.678143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:12.678424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:12.678699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:12.728177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:12.748579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:12.750067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:12.847495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 545/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:12.853370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:12.950635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c12cd-b6eb-41de-a67f-4822d87c8afd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:12.984940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121d384-beb9-42f7-a1fb-4b2811d3e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:12.985624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121d384-beb9-42f7-a1fb-4b2811d3e975 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:12.985909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121d384-beb9-42f7-a1fb-4b2811d3e975 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:12.986232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121d384-beb9-42f7-a1fb-4b2811d3e975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:12.988146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:12.998069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121d384-beb9-42f7-a1fb-4b2811d3e975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:12.999568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121d384-beb9-42f7-a1fb-4b2811d3e975 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-0121d384-beb9-42f7-a1fb-4b2811d3e975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:13.014235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:13.015290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:13.016650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:06:13.016650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:13.016650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:06:13.016650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:13.016650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 557/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:06:13.021143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:13.098921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:13.104415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d021-ea87-4686-9bad-f12f639727b6 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.104703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d021-ea87-4686-9bad-f12f639727b6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.104980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d021-ea87-4686-9bad-f12f639727b6 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.106363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 558/1103] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:06:13.111130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281a0d-bee0-4bab-be7c-649580236fcd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.111442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281a0d-bee0-4bab-be7c-649580236fcd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.111720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281a0d-bee0-4bab-be7c-649580236fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.119886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c255f-4bfd-4b2e-ae53-1d7e689ee3ea None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:13.129686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d8281a0d-bee0-4bab-be7c-649580236fcd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:13.130876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d8281a0d-bee0-4bab-be7c-649580236fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:13.153970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:13.154582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.154862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.155135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.155848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:13.156156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:13.157503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:13.169216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 546/1104] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:13.174716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:13.200283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 559/1105] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:06:13.225214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8281a0d-bee0-4bab-be7c-649580236fcd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:13.273381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665a1d0-f06d-45c8-871a-2ae3863d21d3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:13.310412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:13.311051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.311357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.311630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.318870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:13.320351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:13.322782 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:13.330458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8281a0d-bee0-4bab-be7c-649580236fcd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:06:13.332930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:13.333848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:13.335154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 547/1106] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:06:13.339805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:13.347828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:13.366471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:13.367117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.367434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.367712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.368866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:13.370311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:13.371965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 560/1107] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:13.377500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:13.439487 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666b3ce-4340-4648-90df-7885f66c607d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:13.474320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:13.474927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.475206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.475556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.475678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25787fd-6f30-4118-9f50-57748673c1a0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:13.476241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:13.476544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:13.477958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:13.491283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 548/1108] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:13.497372 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:13.509699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff74e81-7b4f-45b9-9741-1ed6b64a9b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:13.510306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74e81-7b4f-45b9-9741-1ed6b64a9b54 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.510585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74e81-7b4f-45b9-9741-1ed6b64a9b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.510856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74e81-7b4f-45b9-9741-1ed6b64a9b54 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.511568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff74e81-7b4f-45b9-9741-1ed6b64a9b54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:13.512979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff74e81-7b4f-45b9-9741-1ed6b64a9b54 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:13.533835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 561/1109] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:06:13 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:06:13.557605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:13.603729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2d146-8fb1-4625-9dec-b14b6735a510 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:13.640082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19988a09-bb2c-47aa-9602-aecccec00f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:13.640711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19988a09-bb2c-47aa-9602-aecccec00f9d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:13.640989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19988a09-bb2c-47aa-9602-aecccec00f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:13.641261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19988a09-bb2c-47aa-9602-aecccec00f9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:13.642050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19988a09-bb2c-47aa-9602-aecccec00f9d None admin] RBAC: Adding query filter params (role.id=541aaf73a5b241ff94e7416ccfff8606, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=a61ebb13ad8c483fa715e5f6906b05f0) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:13.642358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19988a09-bb2c-47aa-9602-aecccec00f9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:13.643844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19988a09-bb2c-47aa-9602-aecccec00f9d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:13.650723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 549/1110] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:13 2022] GET /identity/v3/role_assignments?user.id=a61ebb13ad8c483fa715e5f6906b05f0&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=541aaf73a5b241ff94e7416ccfff8606 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:15.630136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c47d-0cc9-406a-b570-d27cbf48a3a1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:15.630700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c47d-0cc9-406a-b570-d27cbf48a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:15.630700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c47d-0cc9-406a-b570-d27cbf48a3a1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:15.632057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 562/1111] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:15.637476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eebfe4-2bae-4c61-a46c-370b16b26566 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:15.637847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eebfe4-2bae-4c61-a46c-370b16b26566 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:15.638033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eebfe4-2bae-4c61-a46c-370b16b26566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:15.655943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-16eebfe4-2bae-4c61-a46c-370b16b26566 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:15.657123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-16eebfe4-2bae-4c61-a46c-370b16b26566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:15.721730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 550/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:15.745292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c47d-0cc9-406a-b570-d27cbf48a3a1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:15.789010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:15.848282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c47d-0cc9-406a-b570-d27cbf48a3a1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:15.881358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:15.881927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:15.882208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:15.882481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] PATH_INFO: `/v3/roles/e74e413191434331b30c59872ddd2015` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:15.884193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] RBAC: Authorizing `identity:get_role(role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:15.885566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:15.886893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 563/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:15 2022] GET /identity/v3/roles/e74e413191434331b30c59872ddd2015 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:15.892698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eebfe4-2bae-4c61-a46c-370b16b26566 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:15.945472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:15.988103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eebfe4-2bae-4c61-a46c-370b16b26566 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:16.021490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:16.022113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:16.022391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:16.022662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] PATH_INFO: `/v3/users/e35202353b8e47e296129a8279d99016` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:16.035645 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=e35202353b8e47e296129a8279d99016)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:16.037078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:16.038662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 551/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:15 2022] GET /identity/v3/users/e35202353b8e47e296129a8279d99016 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:16.044569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:16.142547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750c9d-09c3-4dfa-897c-6dbef2e40e2d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:16.152078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:16.177047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:16.177648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:16.177924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:16.178195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:16.242122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:16.243573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:16.336660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 564/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:16.342574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:16.439104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0601b-c284-4f93-9a80-084a9e62c0c6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:16.453181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:16.479169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75e19-19ac-477f-be08-25679ddd71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:16.479825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75e19-19ac-477f-be08-25679ddd71b8 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:16.480103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75e19-19ac-477f-be08-25679ddd71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:16.480374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75e19-19ac-477f-be08-25679ddd71b8 None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:16.481503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75e19-19ac-477f-be08-25679ddd71b8 None admin] RBAC: Authorizing `identity:get_project(project_id=298759d135f74149bf8f573445525138)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:16.482915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75e19-19ac-477f-be08-25679ddd71b8 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:16.484594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 552/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:16 2022] GET /identity/v3/projects/298759d135f74149bf8f573445525138 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:16.490991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:16.500883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:16.589092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561d85a-6d7e-42b5-b731-5759dfad433f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:16.621742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaea1c9-eb9f-4fdc-bf17-0ff76e9dab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:16.622343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaea1c9-eb9f-4fdc-bf17-0ff76e9dab7b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:16.622624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaea1c9-eb9f-4fdc-bf17-0ff76e9dab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:16.622898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaea1c9-eb9f-4fdc-bf17-0ff76e9dab7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:16.623706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaea1c9-eb9f-4fdc-bf17-0ff76e9dab7b None admin] RBAC: Adding query filter params (role.id=e74e413191434331b30c59872ddd2015, scope.project.id=298759d135f74149bf8f573445525138, user.id=e35202353b8e47e296129a8279d99016) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:16.624016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaea1c9-eb9f-4fdc-bf17-0ff76e9dab7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:16.625444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaea1c9-eb9f-4fdc-bf17-0ff76e9dab7b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:16.631219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 565/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:16 2022] GET /identity/v3/role_assignments?user.id=e35202353b8e47e296129a8279d99016&scope.project.id=298759d135f74149bf8f573445525138&role.id=e74e413191434331b30c59872ddd2015 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:18.602755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fb27-2ff5-4a5f-a7ed-d2e1d134ff41 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:18.603430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fb27-2ff5-4a5f-a7ed-d2e1d134ff41 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:18.603430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fb27-2ff5-4a5f-a7ed-d2e1d134ff41 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:18.604674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 553/1118] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:18.609720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33085120-0d42-43a4-a592-b179a292089d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:18.610157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33085120-0d42-43a4-a592-b179a292089d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:18.610281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33085120-0d42-43a4-a592-b179a292089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:18.628617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-33085120-0d42-43a4-a592-b179a292089d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:18.630921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-33085120-0d42-43a4-a592-b179a292089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:18.699712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 566/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:18.722143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6fb27-2ff5-4a5f-a7ed-d2e1d134ff41 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:18.828232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6fb27-2ff5-4a5f-a7ed-d2e1d134ff41 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:18.862999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:18.864153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:18.864436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:18.864712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] PATH_INFO: `/v3/roles/e74e413191434331b30c59872ddd2015` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:18.866285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] RBAC: Authorizing `identity:get_role(role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:18.867742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:18.869210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 554/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:18 2022] GET /identity/v3/roles/e74e413191434331b30c59872ddd2015 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:18.875229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33085120-0d42-43a4-a592-b179a292089d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:18.877477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:18.987840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33085120-0d42-43a4-a592-b179a292089d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:19.022505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:19.023131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:19.023437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:19.023711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] PATH_INFO: `/v3/users/e35202353b8e47e296129a8279d99016` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:19.024848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] RBAC: Authorizing `identity:get_user(user_id=e35202353b8e47e296129a8279d99016)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:19.026276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:19.027883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 567/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:18 2022] GET /identity/v3/users/e35202353b8e47e296129a8279d99016 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:19.033691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:19.082826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:19.132156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954789dd-d684-4d0a-9b6d-5eabeba00956 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:19.165361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fa22f-da92-454f-a7d6-c086f58b2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:19.165980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fa22f-da92-454f-a7d6-c086f58b2983 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:19.166261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fa22f-da92-454f-a7d6-c086f58b2983 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:19.166534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fa22f-da92-454f-a7d6-c086f58b2983 None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:19.167696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fa22f-da92-454f-a7d6-c086f58b2983 None admin] RBAC: Authorizing `identity:get_project(project_id=298759d135f74149bf8f573445525138)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:19.169117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fa22f-da92-454f-a7d6-c086f58b2983 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:19.170751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 555/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:19 2022] GET /identity/v3/projects/298759d135f74149bf8f573445525138 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:19.176802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:19.243624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:19.273890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78c6e-c4b1-473c-9027-6fb120f3db5f None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:19.307339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4302b-51df-41da-92b3-cb3a5589b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:19.307999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4302b-51df-41da-92b3-cb3a5589b128 None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:19.308274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4302b-51df-41da-92b3-cb3a5589b128 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:19.308548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4302b-51df-41da-92b3-cb3a5589b128 None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138/users/e35202353b8e47e296129a8279d99016/roles/e74e413191434331b30c59872ddd2015` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:19.310690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4302b-51df-41da-92b3-cb3a5589b128 None admin] RBAC: Authorizing `identity:create_grant(project_id=298759d135f74149bf8f573445525138, user_id=e35202353b8e47e296129a8279d99016, role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:19.312156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4302b-51df-41da-92b3-cb3a5589b128 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:19.324741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 568/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:06:19 2022] PUT /identity/v3/projects/298759d135f74149bf8f573445525138/users/e35202353b8e47e296129a8279d99016/roles/e74e413191434331b30c59872ddd2015 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:06:21.284646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2a534-4017-4ced-96fa-9264d9ede43a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:21.285244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2a534-4017-4ced-96fa-9264d9ede43a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:21.285244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2a534-4017-4ced-96fa-9264d9ede43a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:21.286563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 556/1124] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:21.291861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5cc1f-d615-431a-96a5-1827d0a6e9f7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:21.292256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5cc1f-d615-431a-96a5-1827d0a6e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:21.292413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5cc1f-d615-431a-96a5-1827d0a6e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:21.310340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c5d5cc1f-d615-431a-96a5-1827d0a6e9f7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:21.311548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c5d5cc1f-d615-431a-96a5-1827d0a6e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:21.376009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 569/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:21.401495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2a534-4017-4ced-96fa-9264d9ede43a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:21.498794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2a534-4017-4ced-96fa-9264d9ede43a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:21.515639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:21.533129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:21.533753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:21.534030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:21.534303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] PATH_INFO: `/v3/roles/e74e413191434331b30c59872ddd2015` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:21.536168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] RBAC: Authorizing `identity:get_role(role_id=e74e413191434331b30c59872ddd2015)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:21.537499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:21.538859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 557/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:21 2022] GET /identity/v3/roles/e74e413191434331b30c59872ddd2015 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:21.544710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5cc1f-d615-431a-96a5-1827d0a6e9f7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:21.601025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:21.642115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5cc1f-d615-431a-96a5-1827d0a6e9f7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:21.674814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:21.675999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:21.676300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:21.676577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] PATH_INFO: `/v3/users/e35202353b8e47e296129a8279d99016` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:21.677726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] RBAC: Authorizing `identity:get_user(user_id=e35202353b8e47e296129a8279d99016)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:21.679161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:21.680776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 570/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:21 2022] GET /identity/v3/users/e35202353b8e47e296129a8279d99016 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:21.686583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:21.783728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf968f9-a7f1-4e33-87d3-9947b47b0e24 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:21.816866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:21.817410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:21.817689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:21.817958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:21.867075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:21.882394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:21.884122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:21.978684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 558/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:21.984518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:22.080866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fab871-e473-4243-86ea-b1f5ff349611 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:22.106776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:22.115604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fd61d-e9fb-44bc-b0e8-ce9dabb44cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:22.116227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fd61d-e9fb-44bc-b0e8-ce9dabb44cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:22.116505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fd61d-e9fb-44bc-b0e8-ce9dabb44cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:22.116776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fd61d-e9fb-44bc-b0e8-ce9dabb44cc0 None admin] PATH_INFO: `/v3/projects/298759d135f74149bf8f573445525138` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:22.117906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fd61d-e9fb-44bc-b0e8-ce9dabb44cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=298759d135f74149bf8f573445525138)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:22.119361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fd61d-e9fb-44bc-b0e8-ce9dabb44cc0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:22.120978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 571/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:21 2022] GET /identity/v3/projects/298759d135f74149bf8f573445525138 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:22.127098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:22.206621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:22.223509 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23696533-7a82-4ee9-a4d6-36910523d79a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:22.255628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ade53-8d42-4151-9e75-2d73d229993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:22.256226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ade53-8d42-4151-9e75-2d73d229993d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:22.256511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ade53-8d42-4151-9e75-2d73d229993d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:22.256788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ade53-8d42-4151-9e75-2d73d229993d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:22.257564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ade53-8d42-4151-9e75-2d73d229993d None admin] RBAC: Adding query filter params (role.id=e74e413191434331b30c59872ddd2015, scope.project.id=298759d135f74149bf8f573445525138, user.id=e35202353b8e47e296129a8279d99016) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:22.257872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ade53-8d42-4151-9e75-2d73d229993d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:22.259567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ade53-8d42-4151-9e75-2d73d229993d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:22.265171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 559/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:22 2022] GET /identity/v3/role_assignments?user.id=e35202353b8e47e296129a8279d99016&scope.project.id=298759d135f74149bf8f573445525138&role.id=e74e413191434331b30c59872ddd2015 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:24.284237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5521-ac1e-4fd7-becb-1d6f6da8173b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:24.284808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5521-ac1e-4fd7-becb-1d6f6da8173b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:24.284808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5521-ac1e-4fd7-becb-1d6f6da8173b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:24.286212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 572/1131] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:24.291238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb9075-5d4c-4370-8d8c-dd54e84a797c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:24.291768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb9075-5d4c-4370-8d8c-dd54e84a797c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:24.291865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb9075-5d4c-4370-8d8c-dd54e84a797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:24.310072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ccfb9075-5d4c-4370-8d8c-dd54e84a797c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:24.311246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ccfb9075-5d4c-4370-8d8c-dd54e84a797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:24.376515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 560/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:24.399408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5521-ac1e-4fd7-becb-1d6f6da8173b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:24.498007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5521-ac1e-4fd7-becb-1d6f6da8173b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:24.530424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43588f-86aa-4a1b-86b0-11d9e12cd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:24.531045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43588f-86aa-4a1b-86b0-11d9e12cd719 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:24.531349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43588f-86aa-4a1b-86b0-11d9e12cd719 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:24.531620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43588f-86aa-4a1b-86b0-11d9e12cd719 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:24.532744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43588f-86aa-4a1b-86b0-11d9e12cd719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:24.534163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43588f-86aa-4a1b-86b0-11d9e12cd719 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:24.535929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 573/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:24.541619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb9075-5d4c-4370-8d8c-dd54e84a797c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:24.617237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:24.639023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb9075-5d4c-4370-8d8c-dd54e84a797c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:24.671662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced2a06-e6bd-40d9-bceb-4d7e2e708a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:24.672271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced2a06-e6bd-40d9-bceb-4d7e2e708a48 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:24.672554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced2a06-e6bd-40d9-bceb-4d7e2e708a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:24.672833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced2a06-e6bd-40d9-bceb-4d7e2e708a48 None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:24.673516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced2a06-e6bd-40d9-bceb-4d7e2e708a48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:24.674955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced2a06-e6bd-40d9-bceb-4d7e2e708a48 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:24.704661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 561/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:06:24 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:26.703361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3b67-f352-428b-ae1c-3590db6a6afe None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:26.703920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3b67-f352-428b-ae1c-3590db6a6afe None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:26.703920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd3b67-f352-428b-ae1c-3590db6a6afe None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:26.705272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 574/1135] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:26.710795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea029e1-4f37-487f-8d77-02205332b8ff None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:26.711228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea029e1-4f37-487f-8d77-02205332b8ff None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:26.711352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea029e1-4f37-487f-8d77-02205332b8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:26.729888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4ea029e1-4f37-487f-8d77-02205332b8ff None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:26.731073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4ea029e1-4f37-487f-8d77-02205332b8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:26.798324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 562/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:26.822260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3b67-f352-428b-ae1c-3590db6a6afe None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:26.884783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:26.922792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd3b67-f352-428b-ae1c-3590db6a6afe None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:26.955881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07872-a7ad-40c2-8810-e09411ecc49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:26.956957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07872-a7ad-40c2-8810-e09411ecc49c None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:26.957396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07872-a7ad-40c2-8810-e09411ecc49c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:26.957605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07872-a7ad-40c2-8810-e09411ecc49c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:26.958760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07872-a7ad-40c2-8810-e09411ecc49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:26.960226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07872-a7ad-40c2-8810-e09411ecc49c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:26.961790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 575/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:26.967539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea029e1-4f37-487f-8d77-02205332b8ff None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:27.025095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:27.065224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea029e1-4f37-487f-8d77-02205332b8ff None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:27.099563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fe7eb-faa3-47ce-b811-d7abfa3ea82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:27.100169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fe7eb-faa3-47ce-b811-d7abfa3ea82b None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:27.100455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fe7eb-faa3-47ce-b811-d7abfa3ea82b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:27.100732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fe7eb-faa3-47ce-b811-d7abfa3ea82b None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:27.101404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fe7eb-faa3-47ce-b811-d7abfa3ea82b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:27.102830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fe7eb-faa3-47ce-b811-d7abfa3ea82b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:27.122738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 563/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:06:26 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:29.147442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb4be-1953-4a44-b9ae-5812ffe7af4b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:29.147975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb4be-1953-4a44-b9ae-5812ffe7af4b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:29.147975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb4be-1953-4a44-b9ae-5812ffe7af4b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:29.149335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 576/1139] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:29.154590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176e67-4f6e-4274-ac31-944f8c16bab8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:29.154962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176e67-4f6e-4274-ac31-944f8c16bab8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:29.155145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176e67-4f6e-4274-ac31-944f8c16bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:29.173014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dc176e67-4f6e-4274-ac31-944f8c16bab8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:29.174223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dc176e67-4f6e-4274-ac31-944f8c16bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:29.239414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 564/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:29.263015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb4be-1953-4a44-b9ae-5812ffe7af4b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:29.361374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb4be-1953-4a44-b9ae-5812ffe7af4b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:29.390600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:29.396219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:29.396856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:29.397139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:29.397416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:29.407899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:29.413210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:29.414395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:29.415385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 577/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:29.420467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176e67-4f6e-4274-ac31-944f8c16bab8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:29.465265 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:29.518326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176e67-4f6e-4274-ac31-944f8c16bab8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:29.551477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:29.552089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:29.552371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:29.552648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:29.553353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:29.553659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:29.555026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:29.563100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 565/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:29.568793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:29.666040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d575-f1ce-422e-99a8-d4aedab60812 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:29.698388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:29.699011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:29.699314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:29.699591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] PATH_INFO: `/v3/users/44150c36af374735b5b8b694b2f2853f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:29.712636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] RBAC: Authorizing `identity:get_user(user_id=44150c36af374735b5b8b694b2f2853f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:29.714074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:29.715717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 578/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:29 2022] GET /identity/v3/users/44150c36af374735b5b8b694b2f2853f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:29.721285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:29.820152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35faf67-d2bc-4c85-a488-69f15f4f7939 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:29.829018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:29.853036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:29.853649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:29.853930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:29.854204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:29.919889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:29.921272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:30.016211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 566/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:30.022111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:30.071200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:30.119988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e014-87dd-44b1-a73a-1c54b583dfbd None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:30.152680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9728166-48d8-45c6-8fb5-731e9500e289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:30.153305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728166-48d8-45c6-8fb5-731e9500e289 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:30.153580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728166-48d8-45c6-8fb5-731e9500e289 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:30.153848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728166-48d8-45c6-8fb5-731e9500e289 None admin] PATH_INFO: `/v3/projects/dc389a01163440d5b0ad3d2f733d327e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:30.154976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9728166-48d8-45c6-8fb5-731e9500e289 None admin] RBAC: Authorizing `identity:get_project(project_id=dc389a01163440d5b0ad3d2f733d327e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:30.156419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9728166-48d8-45c6-8fb5-731e9500e289 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:30.158036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 579/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:30 2022] GET /identity/v3/projects/dc389a01163440d5b0ad3d2f733d327e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:30.165070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:30.174972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:30.262942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7568d-2104-4774-a3e6-c49333835b46 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:30.295746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67badf39-25eb-4ff1-ab0e-a111d5e5ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:30.296346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67badf39-25eb-4ff1-ab0e-a111d5e5ced1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:30.296627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67badf39-25eb-4ff1-ab0e-a111d5e5ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:30.296903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67badf39-25eb-4ff1-ab0e-a111d5e5ced1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:30.297670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67badf39-25eb-4ff1-ab0e-a111d5e5ced1 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=dc389a01163440d5b0ad3d2f733d327e, user.id=44150c36af374735b5b8b694b2f2853f) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:30.297979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67badf39-25eb-4ff1-ab0e-a111d5e5ced1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:30.299437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67badf39-25eb-4ff1-ab0e-a111d5e5ced1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:30.305257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 567/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:30 2022] GET /identity/v3/role_assignments?user.id=44150c36af374735b5b8b694b2f2853f&scope.project.id=dc389a01163440d5b0ad3d2f733d327e&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:06:32.281998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acaebd-7888-4b9c-9a98-25ffffd504b8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:32.282575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acaebd-7888-4b9c-9a98-25ffffd504b8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:32.282575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acaebd-7888-4b9c-9a98-25ffffd504b8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:32.284046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 580/1147] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:32.289791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93fb0-8593-49b6-a2bf-216491331ea8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:32.290193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93fb0-8593-49b6-a2bf-216491331ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:32.290341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93fb0-8593-49b6-a2bf-216491331ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:32.309306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-24a93fb0-8593-49b6-a2bf-216491331ea8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:32.310487 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-24a93fb0-8593-49b6-a2bf-216491331ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:32.374797 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 568/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:32.396801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acaebd-7888-4b9c-9a98-25ffffd504b8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:32.495973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acaebd-7888-4b9c-9a98-25ffffd504b8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:32.513822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:32.530997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:32.531644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:32.531922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:32.532245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:32.542234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:32.546994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:32.548110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:32.549094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 581/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:32.554252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93fb0-8593-49b6-a2bf-216491331ea8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:32.556447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:32.651790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93fb0-8593-49b6-a2bf-216491331ea8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:32.684229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:32.684832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:32.685117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:32.685393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:32.686097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:32.686402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:32.687793 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:32.695617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 569/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:32.701407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:32.800370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8478e-8988-49d7-b8cd-67b15571f3f0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:32.832965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:32.833602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:32.833882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:32.834156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] PATH_INFO: `/v3/users/44150c36af374735b5b8b694b2f2853f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:32.835358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] RBAC: Authorizing `identity:get_user(user_id=44150c36af374735b5b8b694b2f2853f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:32.836800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:32.838384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 582/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:32 2022] GET /identity/v3/users/44150c36af374735b5b8b694b2f2853f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:32.844313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:32.905310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:32.942999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5c87d-9977-47a4-b656-335d91132e3b None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:32.975822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d17f3-24ae-4959-8895-bdab5df9c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:32.976454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d17f3-24ae-4959-8895-bdab5df9c45a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:32.976736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d17f3-24ae-4959-8895-bdab5df9c45a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:32.977012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d17f3-24ae-4959-8895-bdab5df9c45a None admin] PATH_INFO: `/v3/projects/dc389a01163440d5b0ad3d2f733d327e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:32.978178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d17f3-24ae-4959-8895-bdab5df9c45a None admin] RBAC: Authorizing `identity:get_project(project_id=dc389a01163440d5b0ad3d2f733d327e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:32.979700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d17f3-24ae-4959-8895-bdab5df9c45a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:32.981354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 570/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:32 2022] GET /identity/v3/projects/dc389a01163440d5b0ad3d2f733d327e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:32.987221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:33.032516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:33.090164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6bc1-5762-493b-8e06-ceb75e74e17d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:33.125024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438b78-78b5-4ad3-8b7c-547eaa7e1e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:33.125687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438b78-78b5-4ad3-8b7c-547eaa7e1e0c None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:33.125965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438b78-78b5-4ad3-8b7c-547eaa7e1e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:33.126236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438b78-78b5-4ad3-8b7c-547eaa7e1e0c None admin] PATH_INFO: `/v3/projects/dc389a01163440d5b0ad3d2f733d327e/users/44150c36af374735b5b8b694b2f2853f/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:33.128220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa438b78-78b5-4ad3-8b7c-547eaa7e1e0c None admin] RBAC: Authorizing `identity:create_grant(project_id=dc389a01163440d5b0ad3d2f733d327e, user_id=44150c36af374735b5b8b694b2f2853f, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:33.129647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa438b78-78b5-4ad3-8b7c-547eaa7e1e0c None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:33.141960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 583/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:06:32 2022] PUT /identity/v3/projects/dc389a01163440d5b0ad3d2f733d327e/users/44150c36af374735b5b8b694b2f2853f/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:06:35.106197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536b2e1-8e34-4995-bd77-a9da482ac12b None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:35.106757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536b2e1-8e34-4995-bd77-a9da482ac12b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:35.106757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536b2e1-8e34-4995-bd77-a9da482ac12b None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:35.108119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 571/1154] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:35.113167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7af22-c6c5-463a-aa0b-fd19e3ebd577 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:35.113602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7af22-c6c5-463a-aa0b-fd19e3ebd577 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:35.113783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7af22-c6c5-463a-aa0b-fd19e3ebd577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:35.131565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-edb7af22-c6c5-463a-aa0b-fd19e3ebd577 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:35.133003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-edb7af22-c6c5-463a-aa0b-fd19e3ebd577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:35.200890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 584/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:35.225051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536b2e1-8e34-4995-bd77-a9da482ac12b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:35.324269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536b2e1-8e34-4995-bd77-a9da482ac12b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:35.355289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:35.360303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:35.360875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:35.361157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:35.361432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:35.371768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:35.377049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:35.378762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:35.379656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 572/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:35.385100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7af22-c6c5-463a-aa0b-fd19e3ebd577 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:35.419171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:35.483900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7af22-c6c5-463a-aa0b-fd19e3ebd577 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:35.517443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:35.518048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:35.518324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:35.519278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:35.520083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:35.520380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:35.521768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:35.529520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 585/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:35.535464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:35.632869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ef2a-c5c9-4e75-ba7e-36ea403fe3b7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:35.666149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:35.666780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:35.667072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:35.667375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] PATH_INFO: `/v3/users/44150c36af374735b5b8b694b2f2853f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:35.668519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] RBAC: Authorizing `identity:get_user(user_id=44150c36af374735b5b8b694b2f2853f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:35.669934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:35.671539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 573/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:35 2022] GET /identity/v3/users/44150c36af374735b5b8b694b2f2853f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:35.678160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:35.776596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:35.780539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28278bb3-2af8-422e-81c2-89a5c8595442 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:35.813259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:35.813869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:35.814149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:35.814421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:35.880620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:35.882074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:35.973806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:35.978495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 586/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:35.984178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:36.041591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:36.080571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52885a-1a92-4e84-8c1b-370e03c0372a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:36.113139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd062d05-e3c7-498f-8f91-7814dc3f2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:36.113741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd062d05-e3c7-498f-8f91-7814dc3f2c29 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:36.114020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd062d05-e3c7-498f-8f91-7814dc3f2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:36.114292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd062d05-e3c7-498f-8f91-7814dc3f2c29 None admin] PATH_INFO: `/v3/projects/dc389a01163440d5b0ad3d2f733d327e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:36.115459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd062d05-e3c7-498f-8f91-7814dc3f2c29 None admin] RBAC: Authorizing `identity:get_project(project_id=dc389a01163440d5b0ad3d2f733d327e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:36.116879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd062d05-e3c7-498f-8f91-7814dc3f2c29 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:36.118518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 574/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:35 2022] GET /identity/v3/projects/dc389a01163440d5b0ad3d2f733d327e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:36.124677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:36.225914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcde93d-0f8a-47c3-aca0-9ad125af5bcb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:36.258617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deae76-531c-463b-b94e-fecb48ef557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:36.259216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deae76-531c-463b-b94e-fecb48ef557f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:36.259527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deae76-531c-463b-b94e-fecb48ef557f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:36.259801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deae76-531c-463b-b94e-fecb48ef557f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:36.260577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deae76-531c-463b-b94e-fecb48ef557f None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=dc389a01163440d5b0ad3d2f733d327e, user.id=44150c36af374735b5b8b694b2f2853f) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:36.260888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deae76-531c-463b-b94e-fecb48ef557f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:36.262320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deae76-531c-463b-b94e-fecb48ef557f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:36.267933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 587/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:36 2022] GET /identity/v3/role_assignments?user.id=44150c36af374735b5b8b694b2f2853f&scope.project.id=dc389a01163440d5b0ad3d2f733d327e&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:38.285117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0caff-5600-4e0a-8816-b9a35f005f3c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:38.285658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0caff-5600-4e0a-8816-b9a35f005f3c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:38.285658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0caff-5600-4e0a-8816-b9a35f005f3c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:38.287040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 575/1162] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:38.296530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ff26c-b6ce-460d-b225-c2bb80dca630 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:38.296923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ff26c-b6ce-460d-b225-c2bb80dca630 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:38.297097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ff26c-b6ce-460d-b225-c2bb80dca630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:38.314733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b62ff26c-b6ce-460d-b225-c2bb80dca630 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:38.316574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b62ff26c-b6ce-460d-b225-c2bb80dca630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:38.370614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:38.381695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 588/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:38.404268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0caff-5600-4e0a-8816-b9a35f005f3c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:38.504780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0caff-5600-4e0a-8816-b9a35f005f3c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:38.530417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:38.538881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:38.539466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:38.539751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:38.540026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:38.604824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:38.606241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:38.701514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 576/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:38.708546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ff26c-b6ce-460d-b225-c2bb80dca630 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:38.804346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ff26c-b6ce-460d-b225-c2bb80dca630 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:38.837093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1be5c7-f0b9-42d5-ac60-7b6870fb5be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:38.837722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1be5c7-f0b9-42d5-ac60-7b6870fb5be3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:38.838004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1be5c7-f0b9-42d5-ac60-7b6870fb5be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:38.838280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1be5c7-f0b9-42d5-ac60-7b6870fb5be3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:38.844734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1be5c7-f0b9-42d5-ac60-7b6870fb5be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:38.846173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1be5c7-f0b9-42d5-ac60-7b6870fb5be3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-bf1be5c7-f0b9-42d5-ac60-7b6870fb5be3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:38.858081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:38.859143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:38.860205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 589/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:06:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:38.865350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:38.892071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:38.963223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fc3ad-14f3-4f5c-bbac-89d7a2a98a04 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:38.996391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3be51-51e5-43bb-a63e-cfe06927a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:38.997000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3be51-51e5-43bb-a63e-cfe06927a761 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:38.997284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3be51-51e5-43bb-a63e-cfe06927a761 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:38.997559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3be51-51e5-43bb-a63e-cfe06927a761 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:38.998244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3be51-51e5-43bb-a63e-cfe06927a761 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:38.998551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3be51-51e5-43bb-a63e-cfe06927a761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:38.999943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3be51-51e5-43bb-a63e-cfe06927a761 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:39.007202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 577/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 04:06:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:40.974668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f441f-7af1-4b35-9c6c-5cd540dea69d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:40.975197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f441f-7af1-4b35-9c6c-5cd540dea69d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:40.975197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f441f-7af1-4b35-9c6c-5cd540dea69d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:40.976606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 590/1167] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:40.981834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1f1f-ecfa-4a10-9c26-7eaa07f72f87 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:40.982290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1f1f-ecfa-4a10-9c26-7eaa07f72f87 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:40.982398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1f1f-ecfa-4a10-9c26-7eaa07f72f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:41.000643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-aa6e1f1f-ecfa-4a10-9c26-7eaa07f72f87 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:41.001757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-aa6e1f1f-ecfa-4a10-9c26-7eaa07f72f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:41.069925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 578/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:06:41.092330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f441f-7af1-4b35-9c6c-5cd540dea69d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:41.145712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:41.192793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f441f-7af1-4b35-9c6c-5cd540dea69d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:41.224681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67390f-e767-4984-8ba6-23cd822896e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:41.225291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67390f-e767-4984-8ba6-23cd822896e1 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:41.225573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67390f-e767-4984-8ba6-23cd822896e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:41.225850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67390f-e767-4984-8ba6-23cd822896e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:41.226545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67390f-e767-4984-8ba6-23cd822896e1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:41.227937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67390f-e767-4984-8ba6-23cd822896e1 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:41.243746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 591/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Wed Jul 27 04:06:41 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:06:43.257008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410a74-cc7f-4a96-a606-2291d13703b8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:43.257802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410a74-cc7f-4a96-a606-2291d13703b8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:43.257802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410a74-cc7f-4a96-a606-2291d13703b8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:43.259208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 579/1170] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:43.264662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3508-a021-408d-8810-b3442d2a0ca4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:43.265069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3508-a021-408d-8810-b3442d2a0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:43.265218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3508-a021-408d-8810-b3442d2a0ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:43.282743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-abec3508-a021-408d-8810-b3442d2a0ca4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:43.284148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-abec3508-a021-408d-8810-b3442d2a0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:43.349998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 592/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:43.371492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410a74-cc7f-4a96-a606-2291d13703b8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:43.396305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:43.481977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410a74-cc7f-4a96-a606-2291d13703b8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:43.516148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830621f-246b-4f46-a264-ff8f9b612939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:43.516708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830621f-246b-4f46-a264-ff8f9b612939 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:43.516992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830621f-246b-4f46-a264-ff8f9b612939 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:43.517267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830621f-246b-4f46-a264-ff8f9b612939 None admin] PATH_INFO: `/v3/domains/f8308189348c4a079ec33b0686274ace` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:43.527707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830621f-246b-4f46-a264-ff8f9b612939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8308189348c4a079ec33b0686274ace)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:43.529155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830621f-246b-4f46-a264-ff8f9b612939 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:43.530768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 580/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Jul 27 04:06:43 2022] GET /identity/v3/domains/f8308189348c4a079ec33b0686274ace => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:43.537299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3508-a021-408d-8810-b3442d2a0ca4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:43.579722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:43.635645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3508-a021-408d-8810-b3442d2a0ca4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:43.667796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c198f9-209e-4a75-afa1-8e912ce21a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:43.668396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c198f9-209e-4a75-afa1-8e912ce21a1b None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:43.668673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c198f9-209e-4a75-afa1-8e912ce21a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:43.668942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c198f9-209e-4a75-afa1-8e912ce21a1b None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:43.669618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c198f9-209e-4a75-afa1-8e912ce21a1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:43.671035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c198f9-209e-4a75-afa1-8e912ce21a1b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:43.696880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 593/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:06:43 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:45.894391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8ff92-23e9-43da-b811-5dbe8352a149 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:45.894928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8ff92-23e9-43da-b811-5dbe8352a149 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:45.894928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8ff92-23e9-43da-b811-5dbe8352a149 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:45.896349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 581/1174] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:45.901492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab3db-0b2a-4e85-beac-9b598b579994 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:45.901880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab3db-0b2a-4e85-beac-9b598b579994 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:45.902042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab3db-0b2a-4e85-beac-9b598b579994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:45.920479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c8dab3db-0b2a-4e85-beac-9b598b579994 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:45.921657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c8dab3db-0b2a-4e85-beac-9b598b579994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:45.985972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 594/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:46.010799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8ff92-23e9-43da-b811-5dbe8352a149 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:46.091619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:46.110650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8ff92-23e9-43da-b811-5dbe8352a149 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:46.144535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fb3b5-dc7a-4e86-9e3f-1da411fe8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:46.145171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fb3b5-dc7a-4e86-9e3f-1da411fe8c41 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:46.145455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fb3b5-dc7a-4e86-9e3f-1da411fe8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:46.145734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fb3b5-dc7a-4e86-9e3f-1da411fe8c41 None admin] PATH_INFO: `/v3/domains/f8308189348c4a079ec33b0686274ace` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:46.146881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fb3b5-dc7a-4e86-9e3f-1da411fe8c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8308189348c4a079ec33b0686274ace)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:46.148347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fb3b5-dc7a-4e86-9e3f-1da411fe8c41 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:46.149946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 582/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Jul 27 04:06:46 2022] GET /identity/v3/domains/f8308189348c4a079ec33b0686274ace => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:46.155714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab3db-0b2a-4e85-beac-9b598b579994 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:46.180027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:46.251523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab3db-0b2a-4e85-beac-9b598b579994 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:46.284645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf1d62-a3ad-4d70-9bad-0e2df96ea2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:46.285239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1d62-a3ad-4d70-9bad-0e2df96ea2ca None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:46.285515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1d62-a3ad-4d70-9bad-0e2df96ea2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:46.285782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1d62-a3ad-4d70-9bad-0e2df96ea2ca None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:46.286441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf1d62-a3ad-4d70-9bad-0e2df96ea2ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:46.287903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf1d62-a3ad-4d70-9bad-0e2df96ea2ca None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:46.308806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 595/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:06:46 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:06:48.327320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312571-7b92-4c8c-a9ff-b87c9b32aaee None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:48.327885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312571-7b92-4c8c-a9ff-b87c9b32aaee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:48.327885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312571-7b92-4c8c-a9ff-b87c9b32aaee None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:48.329241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 583/1178] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:48.334446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae3cb-93dc-4ac3-ae3f-f3b3481938e7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:48.334870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae3cb-93dc-4ac3-ae3f-f3b3481938e7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:48.335004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae3cb-93dc-4ac3-ae3f-f3b3481938e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:48.353159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ef5ae3cb-93dc-4ac3-ae3f-f3b3481938e7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:48.354356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ef5ae3cb-93dc-4ac3-ae3f-f3b3481938e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:48.420816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 596/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:48.445403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312571-7b92-4c8c-a9ff-b87c9b32aaee None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:48.544086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312571-7b92-4c8c-a9ff-b87c9b32aaee None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:48.578629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:48.579193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:48.579502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:48.579778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:48.589658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:48.594465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:48.595580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:48.597142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 584/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:48.601870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae3cb-93dc-4ac3-ae3f-f3b3481938e7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:48.613763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:48.700641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae3cb-93dc-4ac3-ae3f-f3b3481938e7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:48.734289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:48.734906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:48.735190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:48.735496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:48.736213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:48.736529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:48.737951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:48.746003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 597/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:48.751672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:48.765375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:48.858249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79d638-2025-474f-8dd9-05a494943dcf None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:48.897707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:48.898332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:48.898609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:48.898882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] PATH_INFO: `/v3/users/dded8a9be7934f13b273a83f80fc6d61` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:48.911827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] RBAC: Authorizing `identity:get_user(user_id=dded8a9be7934f13b273a83f80fc6d61)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:48.913250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:48.914854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 585/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:48 2022] GET /identity/v3/users/dded8a9be7934f13b273a83f80fc6d61 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:48.920596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:48.989089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:49.020016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5a93-a613-4dd8-808f-ff45b96f42fe None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:49.052547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:49.053144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:49.053418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:49.053687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:49.123136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:49.124536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:49.191719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:49.222504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 598/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:49.228375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:49.293423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:49.325649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529dd1a-a5e5-4bf6-bbb4-bdcd41386776 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:49.359102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81139b6-a1b3-4f72-ace6-fe0091c3aa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:49.359752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81139b6-a1b3-4f72-ace6-fe0091c3aa12 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:49.360034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81139b6-a1b3-4f72-ace6-fe0091c3aa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:49.360309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81139b6-a1b3-4f72-ace6-fe0091c3aa12 None admin] PATH_INFO: `/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:49.361438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81139b6-a1b3-4f72-ace6-fe0091c3aa12 None admin] RBAC: Authorizing `identity:get_project(project_id=146e9b6934af4b6cb4efbb7e0b8e2bf7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:49.362886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81139b6-a1b3-4f72-ace6-fe0091c3aa12 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:49.364553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 586/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:49 2022] GET /identity/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:49.370730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:49.475781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57956221-1dc8-4a3b-ba37-2c05833f3e61 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:49.508731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec77c7-729a-4aab-9e70-53e7cd016852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:49.509336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec77c7-729a-4aab-9e70-53e7cd016852 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:49.509617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec77c7-729a-4aab-9e70-53e7cd016852 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:49.509894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec77c7-729a-4aab-9e70-53e7cd016852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:49.510674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec77c7-729a-4aab-9e70-53e7cd016852 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=146e9b6934af4b6cb4efbb7e0b8e2bf7, user.id=dded8a9be7934f13b273a83f80fc6d61) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:49.510986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec77c7-729a-4aab-9e70-53e7cd016852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:49.512454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec77c7-729a-4aab-9e70-53e7cd016852 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:49.517808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 599/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:49 2022] GET /identity/v3/role_assignments?user.id=dded8a9be7934f13b273a83f80fc6d61&scope.project.id=146e9b6934af4b6cb4efbb7e0b8e2bf7&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:51.478150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ada9-07a8-4f2e-a03f-35ac0b1c989f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:51.478709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ada9-07a8-4f2e-a03f-35ac0b1c989f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:51.478709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75ada9-07a8-4f2e-a03f-35ac0b1c989f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:51.480068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 587/1186] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:51.485214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dabb8-af90-4abd-96a0-fdaa419b58f7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:51.485642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dabb8-af90-4abd-96a0-fdaa419b58f7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:51.485767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dabb8-af90-4abd-96a0-fdaa419b58f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:51.503555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8f7dabb8-af90-4abd-96a0-fdaa419b58f7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:51.504750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8f7dabb8-af90-4abd-96a0-fdaa419b58f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:51.534590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:51.571742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 600/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:51.594056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75ada9-07a8-4f2e-a03f-35ac0b1c989f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:51.693050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75ada9-07a8-4f2e-a03f-35ac0b1c989f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:51.726488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:51.727118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:51.727431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:51.727704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:51.730412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:51.739068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:51.743962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:51.745130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:06:51.746249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 588/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:51.751193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dabb8-af90-4abd-96a0-fdaa419b58f7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:51.853058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dabb8-af90-4abd-96a0-fdaa419b58f7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:51.886490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:51.887099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:51.887410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:51.887685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:51.888394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:51.888698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:51.890063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:51.898550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 601/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:51.904299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:52.001568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f5b45-916b-44ca-a8fa-22eae62ef433 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:52.035586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:52.036210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:52.036492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:52.036771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] PATH_INFO: `/v3/users/dded8a9be7934f13b273a83f80fc6d61` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:52.037923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] RBAC: Authorizing `identity:get_user(user_id=dded8a9be7934f13b273a83f80fc6d61)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:52.039380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:52.040964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 589/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:51 2022] GET /identity/v3/users/dded8a9be7934f13b273a83f80fc6d61 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:52.046722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:52.075408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:52.145264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97a930-6fe9-4ed3-b9f3-7ce875d2a687 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:52.177856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b54c9d-3ff3-4710-b19d-282ccf3414ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:52.178481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b54c9d-3ff3-4710-b19d-282ccf3414ce None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:52.178761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b54c9d-3ff3-4710-b19d-282ccf3414ce None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:52.179042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b54c9d-3ff3-4710-b19d-282ccf3414ce None admin] PATH_INFO: `/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:52.180210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b54c9d-3ff3-4710-b19d-282ccf3414ce None admin] RBAC: Authorizing `identity:get_project(project_id=146e9b6934af4b6cb4efbb7e0b8e2bf7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:52.181638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b54c9d-3ff3-4710-b19d-282ccf3414ce None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:52.183309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 602/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:52 2022] GET /identity/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:52.189287 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:52.250181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:52.289559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f767a7f-66b9-40f9-a7ba-cac0d85d8471 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:52.323900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331337c-f463-43f0-b1be-3196e761cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:52.324553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331337c-f463-43f0-b1be-3196e761cefd None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:52.324830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331337c-f463-43f0-b1be-3196e761cefd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:52.325100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331337c-f463-43f0-b1be-3196e761cefd None admin] PATH_INFO: `/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7/users/dded8a9be7934f13b273a83f80fc6d61/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:52.326980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331337c-f463-43f0-b1be-3196e761cefd None admin] RBAC: Authorizing `identity:create_grant(project_id=146e9b6934af4b6cb4efbb7e0b8e2bf7, user_id=dded8a9be7934f13b273a83f80fc6d61, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:52.328418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331337c-f463-43f0-b1be-3196e761cefd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:52.340834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 590/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:06:52 2022] PUT /identity/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7/users/dded8a9be7934f13b273a83f80fc6d61/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:06:54.325844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8c0e-41aa-4313-81d1-877766ed7aff None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:54.326372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8c0e-41aa-4313-81d1-877766ed7aff None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:54.326372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8c0e-41aa-4313-81d1-877766ed7aff None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:54.327792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 603/1193] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:06:54.333404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105591d-2db9-46a1-bba4-59682a0c239d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:54.333827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105591d-2db9-46a1-bba4-59682a0c239d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:54.333956 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105591d-2db9-46a1-bba4-59682a0c239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:54.351490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7105591d-2db9-46a1-bba4-59682a0c239d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:06:54.352662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7105591d-2db9-46a1-bba4-59682a0c239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:06:54.416553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 591/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:06:54.440334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec8c0e-41aa-4313-81d1-877766ed7aff None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:54.535877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:54.543130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec8c0e-41aa-4313-81d1-877766ed7aff None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:54.574524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:54.575150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:54.575461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:54.575732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:54.586514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:06:54.591205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:06:54.592364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:06:54.593455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 604/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:06:54.599251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105591d-2db9-46a1-bba4-59682a0c239d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:54.652181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:54.696847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105591d-2db9-46a1-bba4-59682a0c239d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:54.730502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:54.731122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:54.731431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:54.731707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:54.732418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:54.732728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:54.734080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:54.742278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 592/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:54.747971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:54.845828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994d9a6-1357-427c-9144-4a2be0879cb8 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:54.878431 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:54.879055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:54.879363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:54.879643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] PATH_INFO: `/v3/users/dded8a9be7934f13b273a83f80fc6d61` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:54.880797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] RBAC: Authorizing `identity:get_user(user_id=dded8a9be7934f13b273a83f80fc6d61)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:54.882484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:54.884086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 605/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 04:06:54 2022] GET /identity/v3/users/dded8a9be7934f13b273a83f80fc6d61 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:54.889836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:54.991446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ea127-0904-4375-aa9a-e8ccccd2ffa6 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:55.007635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:55.025770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:55.026377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:55.026660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:55.026939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:55.092513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:55.093950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:55.190625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 593/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:06:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:06:55.196495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:55.221463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:55.294013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b0ec1-cffb-4d32-b7ff-589a5c594156 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:55.326647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1ac0c-4ed0-46ee-89f5-9be94c13f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:55.327301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1ac0c-4ed0-46ee-89f5-9be94c13f424 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:55.327584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1ac0c-4ed0-46ee-89f5-9be94c13f424 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:55.327859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1ac0c-4ed0-46ee-89f5-9be94c13f424 None admin] PATH_INFO: `/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:55.329004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1ac0c-4ed0-46ee-89f5-9be94c13f424 None admin] RBAC: Authorizing `identity:get_project(project_id=146e9b6934af4b6cb4efbb7e0b8e2bf7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:55.330503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1ac0c-4ed0-46ee-89f5-9be94c13f424 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:55.332373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 606/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 04:06:55 2022] GET /identity/v3/projects/146e9b6934af4b6cb4efbb7e0b8e2bf7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:06:55.338416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:06:55.355276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:06:55.435052 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcaf0e-f4e7-41bd-8781-d6c1a5db9827 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:06:55.468138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec51df-090d-4b1f-9e75-7fbdb7cf08a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:06:55.468674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec51df-090d-4b1f-9e75-7fbdb7cf08a1 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:06:55.468951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec51df-090d-4b1f-9e75-7fbdb7cf08a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:06:55.469221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec51df-090d-4b1f-9e75-7fbdb7cf08a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:06:55.469994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec51df-090d-4b1f-9e75-7fbdb7cf08a1 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=146e9b6934af4b6cb4efbb7e0b8e2bf7, user.id=dded8a9be7934f13b273a83f80fc6d61) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:06:55.470298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec51df-090d-4b1f-9e75-7fbdb7cf08a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:06:55.471803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec51df-090d-4b1f-9e75-7fbdb7cf08a1 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:06:55.477411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 594/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:06:55 2022] GET /identity/v3/role_assignments?user.id=dded8a9be7934f13b273a83f80fc6d61&scope.project.id=146e9b6934af4b6cb4efbb7e0b8e2bf7&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:05.322617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=54 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:05.474828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=60 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:50.574702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae490ae-6182-447e-8061-412aba955bc1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:50.575367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae490ae-6182-447e-8061-412aba955bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:50.575367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae490ae-6182-447e-8061-412aba955bc1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:50.576871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 607/1201] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:07:50.583362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b39a-c242-42d6-8eae-8cca18aa1fd4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:50.583836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b39a-c242-42d6-8eae-8cca18aa1fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:50.583946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b39a-c242-42d6-8eae-8cca18aa1fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:50.607230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6d66b39a-c242-42d6-8eae-8cca18aa1fd4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:07:50.608749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d66b39a-c242-42d6-8eae-8cca18aa1fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:07:50.695405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 595/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:07:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:07:50.721014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae490ae-6182-447e-8061-412aba955bc1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:50.861892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae490ae-6182-447e-8061-412aba955bc1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:50.900546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:50.901476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:50.901759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:50.902036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:50.914068 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:50.915526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:07:50.935908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:50.942632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:50.943727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:07:50.943727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:07:50.943727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:50.943727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:07:50.943727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 608/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:50.944047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66b39a-c242-42d6-8eae-8cca18aa1fd4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:51.082426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66b39a-c242-42d6-8eae-8cca18aa1fd4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:51.117312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:51.127110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7d5d6-d43b-4c6f-a0ad-8a2655d1fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:51.127828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7d5d6-d43b-4c6f-a0ad-8a2655d1fa62 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:51.128189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7d5d6-d43b-4c6f-a0ad-8a2655d1fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:51.128449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7d5d6-d43b-4c6f-a0ad-8a2655d1fa62 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:51.129245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7d5d6-d43b-4c6f-a0ad-8a2655d1fa62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:51.129582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7d5d6-d43b-4c6f-a0ad-8a2655d1fa62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:51.131311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7d5d6-d43b-4c6f-a0ad-8a2655d1fa62 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:51.153889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 596/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:51.154111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:51.224096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:51.283602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2bd31-c008-450a-a093-3d5fc008e795 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:51.330152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce374ac3-2e38-45fc-9a6f-6d34cf2a8090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:51.330883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374ac3-2e38-45fc-9a6f-6d34cf2a8090 None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:51.331137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374ac3-2e38-45fc-9a6f-6d34cf2a8090 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:51.331449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374ac3-2e38-45fc-9a6f-6d34cf2a8090 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:51.332222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce374ac3-2e38-45fc-9a6f-6d34cf2a8090 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:51.333750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce374ac3-2e38-45fc-9a6f-6d34cf2a8090 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:51.363782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 609/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 04:07:51 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:07:53.513010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f67f-c52e-4ebf-b79f-02b12dcd1481 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:53.513574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f67f-c52e-4ebf-b79f-02b12dcd1481 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:53.513574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f67f-c52e-4ebf-b79f-02b12dcd1481 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:53.515785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 597/1206] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:07:53.521041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282d21-ef25-4609-a617-6b6c722a3db7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:53.521496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282d21-ef25-4609-a617-6b6c722a3db7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:53.521584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282d21-ef25-4609-a617-6b6c722a3db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:53.541832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-16282d21-ef25-4609-a617-6b6c722a3db7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:07:53.543067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-16282d21-ef25-4609-a617-6b6c722a3db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:07:53.622215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 610/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:07:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:07:53.645740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2f67f-c52e-4ebf-b79f-02b12dcd1481 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:53.778534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2f67f-c52e-4ebf-b79f-02b12dcd1481 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:53.817850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:53.821808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:53.821808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:53.821808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:53.834334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:07:53.840129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:53.841312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:07:53.844194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 598/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:53.848305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16282d21-ef25-4609-a617-6b6c722a3db7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:53.894384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:53.969556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16282d21-ef25-4609-a617-6b6c722a3db7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:54.017982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:54.018702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:54.019003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:54.019295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:54.020162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:54.020492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:54.022319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:54.035358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 611/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:07:54.037883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:54.099589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:54.167838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12577b2-7c0f-46f3-8b52-1053cec70360 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:54.212360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:54.213030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:54.213324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:54.213589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:54.225417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:54.226885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:07:54.243294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:54.244537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:54.245463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:07:54.245463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:07:54.245463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:54.245463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:07:54.245463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 599/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:54.250659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:54.376533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:54.380131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a47964-15e8-4fa0-9b8b-474a383dada0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:54.419297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:54.419959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:54.420299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:54.420633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:54.421384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:54.421688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:54.423069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:54.436284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 612/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:54.442265 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:54.563860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a353e-8cfb-4088-91d8-1468a958595d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:54.565452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:54.601619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:54.601619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:54.601619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:54.601619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:54.609323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:54.610775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:07:54.622587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:54.623693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:07:54.625700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 600/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:07:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:54.630509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:54.755753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864ca62-ddd6-4d4c-be94-53a9e44b1eec None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:54.800510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:54.801139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:54.801454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:54.801698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:54.802511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:54.802804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:54.804290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:54.828381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 613/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 04:07:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:54.834868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:54.954599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63cfe1-bd30-4cc0-ae92-718c6a09ef30 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:54.990429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:54.991618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:54.991858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:54.992187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:55.028230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:55.073920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:55.075555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:55.198798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 601/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:07:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:07:55.206466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:55.245860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:55.385796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13578d-9f93-4979-beaf-48fc1b154dc7 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:55.443063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:55.444316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:55.444908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:55.445638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:55.464743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:55.468861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:07:55.492811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:55.494017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:55.495161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:07:55.495161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:07:55.495161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:55.495161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:07:55.495161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 614/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:07:55.505047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:55.575098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:55.619327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5c36-57b5-4ce0-ab9a-a5043da756d3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:55.660252 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:55.660993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:55.661379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:55.661675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:55.662415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:55.662800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:55.664432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:55.678327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 602/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:55.684047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:55.770113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:55.809789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c4d4-be90-4e15-8601-26fe058e9e13 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:55.848201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:55.848890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:55.849180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:55.849457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:55.856636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:55.858653 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:07:55.870746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:55.871931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:07:55.872911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 615/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:55.880102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:55.996902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37fcb3-8230-4a17-94d1-36487dbf9123 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:56.020395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:56.033958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308060bf-ae38-42f9-be1c-228cd9db56ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:56.034683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308060bf-ae38-42f9-be1c-228cd9db56ea None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:56.035040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308060bf-ae38-42f9-be1c-228cd9db56ea None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:56.035417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308060bf-ae38-42f9-be1c-228cd9db56ea None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:56.036274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308060bf-ae38-42f9-be1c-228cd9db56ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:56.036632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308060bf-ae38-42f9-be1c-228cd9db56ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:56.038140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308060bf-ae38-42f9-be1c-228cd9db56ea None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:56.052238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 603/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:56.060090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:56.182326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d201608-d71a-4b54-a689-ec723bfa0d7e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:56.224447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:56.236269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3657c1-eed9-49b9-9970-f7b1d0584ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:56.236915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3657c1-eed9-49b9-9970-f7b1d0584ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:56.237242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3657c1-eed9-49b9-9970-f7b1d0584ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:56.237462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3657c1-eed9-49b9-9970-f7b1d0584ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:56.238264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3657c1-eed9-49b9-9970-f7b1d0584ba0 None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=19e9ac125aab4b6bb623a02add505b41) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:56.238562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3657c1-eed9-49b9-9970-f7b1d0584ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:56.240027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3657c1-eed9-49b9-9970-f7b1d0584ba0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:56.245788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 616/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:07:56 2022] GET /identity/v3/role_assignments?user.id=19e9ac125aab4b6bb623a02add505b41&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:58.588247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244fb3-5173-4a50-b653-311db90946a9 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:58.588899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244fb3-5173-4a50-b653-311db90946a9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:58.588899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244fb3-5173-4a50-b653-311db90946a9 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:58.590143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 604/1220] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:07:58.595440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edbff6-a477-498a-a471-49c3f0a122ed None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:58.595886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edbff6-a477-498a-a471-49c3f0a122ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:58.596029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edbff6-a477-498a-a471-49c3f0a122ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:58.613794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-58edbff6-a477-498a-a471-49c3f0a122ed None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:07:58.614987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-58edbff6-a477-498a-a471-49c3f0a122ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:07:58.692984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 617/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:07:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:07:58.718641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f244fb3-5173-4a50-b653-311db90946a9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:58.833355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f244fb3-5173-4a50-b653-311db90946a9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:58.868779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:58.869349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:58.869612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:58.869878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:58.880860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:07:58.885701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:58.886701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:07:58.887634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 605/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:58.893530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edbff6-a477-498a-a471-49c3f0a122ed None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:58.999575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edbff6-a477-498a-a471-49c3f0a122ed None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:59.025211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:59.036401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:59.037022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:59.037338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:59.037710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:59.038475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] RBAC: Adding query filter params (name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:59.038779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:59.040187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:59.049224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 618/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:59.055308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:59.104272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:59.171793 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a4a29-63f9-4ef3-b77b-7b94b5169eb7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:59.210265 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:59.210909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:59.211193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:59.211503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:59.222312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:59.223832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:07:59.241379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:59.242480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:59.243651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:07:59.243651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:07:59.243651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:59.243651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:07:59.243651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 606/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:07:59.249949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:59.359942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106d41-22ae-4598-8c90-67323a3db71d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:59.394388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:59.395004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:59.395312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:59.395593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:59.396278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:59.396582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:59.397957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:59.410170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 619/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:07:59.415900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:59.523573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:59.532332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee45f-e395-41cc-8271-cec1be5928e4 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:59.575018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:59.575751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:59.576033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:59.576307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:59.584529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:59.585947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:07:59.600919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:59.602547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:07:59.603792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 607/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:07:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:59.609086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:59.664415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:07:59.719510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f520e8-f1c8-4b91-aa9c-cf2b41fbdff6 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:59.762238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:59.762850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:59.763125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:59.763433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:59.764757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:07:59.765069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:59.766495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:59.784451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 620/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 04:07:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:07:59.790075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:07:59.902387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186a35-76ab-4a5e-8206-6e5d0f00fd25 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:07:59.939859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:07:59.940492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:07:59.940779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:07:59.941037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:07:59.953398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:07:59.955078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:07:59.971450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:07:59.972626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:07:59.973630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:07:59.973630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:07:59.973630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:07:59.973630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:07:59.973630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 608/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:07:59.979492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:00.097953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9c90-a1ee-40b3-837f-c6b2571afe29 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:00.100473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:00.135913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:00.136691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:00.137142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:00.137391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:00.138303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:00.138669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:00.140474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:00.153530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 621/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:00.160285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:00.172760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:00.277786 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816be681-fb3e-432d-baaf-629d894967eb None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:00.313071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:00.313691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:00.313968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:00.314240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:00.322531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:00.324340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:08:00.337421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:00.338747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:00.339857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 609/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:00.345565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:00.454943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb98cea-6498-45d2-9266-69868d5911cf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:00.498802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7a30-72f8-4c31-bb90-61ef04ead2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:00.499700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a30-72f8-4c31-bb90-61ef04ead2fb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:00.500074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a30-72f8-4c31-bb90-61ef04ead2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:00.500457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a30-72f8-4c31-bb90-61ef04ead2fb None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:00.501430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7a30-72f8-4c31-bb90-61ef04ead2fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:00.501764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7a30-72f8-4c31-bb90-61ef04ead2fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:00.503529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7a30-72f8-4c31-bb90-61ef04ead2fb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:00.517421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 622/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:00.524178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:00.599504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:00.636840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea5c3e-93a6-461d-9ccb-fc220bf4daa7 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:00.674140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b03be-eeed-4762-961e-4046284f0562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:00.674804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b03be-eeed-4762-961e-4046284f0562 None admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:00.675084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b03be-eeed-4762-961e-4046284f0562 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:00.675390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b03be-eeed-4762-961e-4046284f0562 None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/19e9ac125aab4b6bb623a02add505b41/roles/ee92e7b31add479ea825c953e000b04d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:00.690629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b03be-eeed-4762-961e-4046284f0562 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=19e9ac125aab4b6bb623a02add505b41, role_id=ee92e7b31add479ea825c953e000b04d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:00.692113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b03be-eeed-4762-961e-4046284f0562 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:00.705523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 610/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:08:00 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/19e9ac125aab4b6bb623a02add505b41/roles/ee92e7b31add479ea825c953e000b04d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:08:02.740729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68141-5710-4349-9871-37a010bb65a8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:02.741273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68141-5710-4349-9871-37a010bb65a8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:02.741273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68141-5710-4349-9871-37a010bb65a8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:02.743301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 623/1233] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:02.749915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e892d-b251-45a2-a46e-f8d7069a1d28 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:02.750354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e892d-b251-45a2-a46e-f8d7069a1d28 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:02.750467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e892d-b251-45a2-a46e-f8d7069a1d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:02.769400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5f8e892d-b251-45a2-a46e-f8d7069a1d28 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:02.770597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5f8e892d-b251-45a2-a46e-f8d7069a1d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:02.839344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 611/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:08:02.863252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68141-5710-4349-9871-37a010bb65a8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:02.892137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:02.979687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68141-5710-4349-9871-37a010bb65a8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:03.018766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:03.019412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:03.019718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:03.020066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:03.032115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:08:03.037786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:03.038935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:03.039856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 624/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 04:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:03.046362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e892d-b251-45a2-a46e-f8d7069a1d28 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:03.097054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:03.153921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e892d-b251-45a2-a46e-f8d7069a1d28 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:03.190842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:03.191420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:03.191698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:03.191968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:03.192674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] RBAC: Adding query filter params (name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:03.192976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:03.194334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:03.202584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 612/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 04:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:03.208432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:03.300917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:03.317754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff384-d575-44fc-8292-f68d5ad95a4e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:03.356815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:03.357468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:03.357751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:03.358029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:03.369695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:03.371150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:03.387850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:03.389696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:03.390767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:03.390767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:03.390767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:03.390767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:03.390767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 625/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:03.396059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:03.507772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786f1f-1b51-4549-9377-c68cfeb0d59d None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:03.518915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:03.546920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:03.547667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:03.547977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:03.548284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:03.549047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:03.549387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:03.550998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:03.564758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 613/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:03.570628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:03.680381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6907c2-6329-4d93-babb-08ae3b01f888 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:03.720371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:03.721092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:03.721302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:03.721578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:03.727406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:03.733560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:03.735313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:08:03.747735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:03.749961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:03.751254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:03.755310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 626/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:08:03.755628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:03.864080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14e7b-38b1-4fb4-b5ea-9a4a2f8eae84 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:03.902833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:03.903515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:03.903859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:03.904135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:03.905121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:03.905431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:03.906978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:03.926322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 614/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 04:08:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:08:03.932430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:04.046566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fffff1-36b2-4ec3-aed6-9ed1fabee0eb None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:04.083104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:04.083982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:04.084446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:04.084851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:04.150587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:04.158624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:04.160446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:04.271875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 627/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:08:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:08:04.277893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:04.311851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:04.391577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cbc0a-b779-4293-8db8-9b8aee4f39b3 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:04.430318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:04.430887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:04.431173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:04.431493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:04.442650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:04.444119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:04.459162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:04.460324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:04.461384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:04.461384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:04.461384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:04.461384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:04.461384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 615/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:04.466501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:04.583118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:04.589278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c7aa7-d07f-4bb7-8206-7e3ef4ee9672 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:04.624849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:04.625833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:04.626341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:04.626793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:04.627814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:04.628283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:04.630274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:04.642521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 628/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:08:04.648541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:04.736483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:04.761822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f6292-9fd2-4089-8d80-a686ccc5744f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:04.799121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:04.799871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:04.800176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:04.800476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:04.807370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:04.808813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:08:04.821404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:04.822492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:04.829266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 616/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:04.831151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:04.941986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cc775-005b-4fa6-8cf8-9ffe5f1968da None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:04.982585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc59134-2887-4b99-96c8-9739e0ce36b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:04.983409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59134-2887-4b99-96c8-9739e0ce36b3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:04.983689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59134-2887-4b99-96c8-9739e0ce36b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:04.984149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc59134-2887-4b99-96c8-9739e0ce36b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:04.985087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc59134-2887-4b99-96c8-9739e0ce36b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:04.985398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc59134-2887-4b99-96c8-9739e0ce36b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:04.987689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc59134-2887-4b99-96c8-9739e0ce36b3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:05.001418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 629/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:08:05.008249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:05.120839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d578-58c7-45ed-8690-41a4adfefe93 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:05.162275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3b5ab-7f1f-4938-b9f6-4a392e5eda7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:05.163212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3b5ab-7f1f-4938-b9f6-4a392e5eda7f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:05.163518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3b5ab-7f1f-4938-b9f6-4a392e5eda7f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:05.163812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3b5ab-7f1f-4938-b9f6-4a392e5eda7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:05.164604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3b5ab-7f1f-4938-b9f6-4a392e5eda7f None admin] RBAC: Adding query filter params (role.id=ee92e7b31add479ea825c953e000b04d, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=19e9ac125aab4b6bb623a02add505b41) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:05.164897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3b5ab-7f1f-4938-b9f6-4a392e5eda7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:05.166345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3b5ab-7f1f-4938-b9f6-4a392e5eda7f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:05.172955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 617/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:08:05 2022] GET /identity/v3/role_assignments?user.id=19e9ac125aab4b6bb623a02add505b41&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=ee92e7b31add479ea825c953e000b04d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:07.375122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224958a-ba8f-4dfd-9220-69ab24d551af None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:07.375726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224958a-ba8f-4dfd-9220-69ab24d551af None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:07.375846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224958a-ba8f-4dfd-9220-69ab24d551af None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:07.377802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 630/1247] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:07.384273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765f53b-2e94-42d4-a23b-52d12da8cbdf None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:07.384722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765f53b-2e94-42d4-a23b-52d12da8cbdf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:07.384835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765f53b-2e94-42d4-a23b-52d12da8cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:07.392056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:07.408599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a765f53b-2e94-42d4-a23b-52d12da8cbdf None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:07.409843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a765f53b-2e94-42d4-a23b-52d12da8cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:07.491337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 618/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 04:08:07.516599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224958a-ba8f-4dfd-9220-69ab24d551af None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:07.538801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:07.632709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224958a-ba8f-4dfd-9220-69ab24d551af None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:07.672942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:07.673662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:07.674098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:07.674380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:07.686118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:08:07.691590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:07.692792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:07.693844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 631/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:07.700834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765f53b-2e94-42d4-a23b-52d12da8cbdf None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:07.823012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765f53b-2e94-42d4-a23b-52d12da8cbdf None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:07.856879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:07.864569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:07.865307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:07.865626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:07.865932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:07.866657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:07.866963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:07.868468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:07.879222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 619/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:07.885268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:07.972640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:07.999696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992d26-9648-41dd-bfe2-a0b6a5d59b77 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:08.039458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:08.040110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:08.040396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:08.040674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:08.052389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:08.053862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:08.069977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:08.071099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:08.072658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:08.072658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:08.072658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:08.072658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:08.072658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 632/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:08:08.077233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:08.188904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c8544-4100-48dd-aa5a-17af25b37eab None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:08.228896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:08.229544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:08.229830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:08.230113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:08.230917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:08.231247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:08.233512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:08.245909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 620/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:08:08.252704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:08.373855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376be24f-eb6b-432e-b45e-82d824ccca19 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:08.401227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:08.411071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:08.411972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:08.412297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:08.412641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:08.421000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:08.422502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:08:08.435320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:08.436619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:08.437822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 633/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:08.443000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:08.513523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:08.568380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554581b4-68eb-4f73-b7a7-9eabbc918328 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:08.606555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:08.611353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:08.611723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:08.612098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:08.613184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:08.613498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:08.614928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:08.636009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 621/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 04:08:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:08.642823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:08.749905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cc0d1-24e8-4811-9027-2878e77b7395 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:08.791211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:08.791976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:08.792285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:08.792543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:08.855162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:08.870708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:08.873515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:09.004400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 634/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:08:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 04:08:09.010491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:09.122829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eed7f-6bbc-455a-9a14-3ba09c05409a None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:09.136100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:09.162135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:09.162963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:09.163329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:09.163630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:09.177368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:09.179095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:09.198329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:09.199497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:09.200572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:09.200572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:09.200572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:09.200572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:09.200572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 622/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:09.207029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:09.301784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:09.315168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaec94-d330-4b29-88ff-c3b19c7ad37e None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:09.351868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:09.352502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:09.352787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:09.353076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:09.353772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:09.354081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:09.355487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:09.368399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 635/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:09.373978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:09.477926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009147f-eb20-43b5-85bb-073f0fcc9681 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:09.515683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:09.516357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:09.516612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:09.516889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:09.524641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:09.526099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:08:09.540415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:09.541719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:09.543219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 623/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:09.548236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:09.661178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670a469-f004-4f2c-bb26-d601e5949490 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:09.696958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f999c5-14a4-4123-b3e5-0e234e5204ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:09.697584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f999c5-14a4-4123-b3e5-0e234e5204ab None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:09.697868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f999c5-14a4-4123-b3e5-0e234e5204ab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:09.698145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f999c5-14a4-4123-b3e5-0e234e5204ab None admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:09.698894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f999c5-14a4-4123-b3e5-0e234e5204ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:09.699206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f999c5-14a4-4123-b3e5-0e234e5204ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:09.700674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f999c5-14a4-4123-b3e5-0e234e5204ab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:09.720237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 636/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:09.721598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:09.751736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:09.833718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee4abb-248d-46ad-b2c1-640a3cf0d993 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:09.869935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57dbb7-b5dd-457e-926b-0784771e1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:09.870689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57dbb7-b5dd-457e-926b-0784771e1658 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:09.870970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57dbb7-b5dd-457e-926b-0784771e1658 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:09.871246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57dbb7-b5dd-457e-926b-0784771e1658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:09.872060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57dbb7-b5dd-457e-926b-0784771e1658 None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=19e9ac125aab4b6bb623a02add505b41) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:09.872419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57dbb7-b5dd-457e-926b-0784771e1658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:09.874432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57dbb7-b5dd-457e-926b-0784771e1658 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:09.880556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 624/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:08:09 2022] GET /identity/v3/role_assignments?user.id=19e9ac125aab4b6bb623a02add505b41&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:11.918337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce586-be78-47f4-8811-c523a28c8e82 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:11.918909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce586-be78-47f4-8811-c523a28c8e82 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:11.918909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce586-be78-47f4-8811-c523a28c8e82 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:11.920779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 637/1261] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:11.925734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55d1dc-afe7-4f96-81c5-5021e5af1d4f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:11.926118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55d1dc-afe7-4f96-81c5-5021e5af1d4f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:11.926283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55d1dc-afe7-4f96-81c5-5021e5af1d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:11.944489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-de55d1dc-afe7-4f96-81c5-5021e5af1d4f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:11.945667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-de55d1dc-afe7-4f96-81c5-5021e5af1d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:12.010996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 625/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:08:12.033987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dce586-be78-47f4-8811-c523a28c8e82 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:12.044784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:12.134021 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dce586-be78-47f4-8811-c523a28c8e82 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:12.166985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:12.167642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:12.167923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:12.168194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:12.178603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:08:12.183481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:12.184626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:12.185970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 638/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:12.190629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55d1dc-afe7-4f96-81c5-5021e5af1d4f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:12.209009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:12.287571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55d1dc-afe7-4f96-81c5-5021e5af1d4f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:12.320414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:12.321025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:12.321306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:12.321581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:12.322282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:12.322584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:12.323983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:12.332148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 626/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:12.337749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:12.405382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:12.438138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba920-7f07-4229-81a4-5a51c6adc92d None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:12.473857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:12.474541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:12.474876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:12.475163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:12.486397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:12.487994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:12.502797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:12.504019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:12.505123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:12.505123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:12.505123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:12.505123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:12.505123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 639/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:12.510425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:12.596211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:12.614654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98901dd6-f1be-4e20-80e6-b227eb92e8ea None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:12.647407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:12.648016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:12.648299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:12.648604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:12.649285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:12.649591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:12.650950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:12.663734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 627/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:12.669327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:12.766946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714b35-c8af-4e40-9381-89f26b6238a0 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:12.786359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:12.800440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:12.801071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:12.801355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:12.801632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:12.808853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:12.810904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:08:12.821900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:12.823015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:12.824405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 640/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:12.829429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:12.924823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3159-110e-4c63-8498-7f9c6409f477 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:12.959320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:12.959923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:12.960209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:12.960483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:12.961263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:12.961569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:12.962975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:12.972095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:12.980651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 628/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 04:08:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:12.987459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:13.085218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e06b81-fc46-4ae0-9cc5-a9d419152778 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:13.118579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:13.119195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:13.119499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:13.119772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:13.130597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:13.132057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:13.146691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:13.147778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:13.148855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:13.148855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:13.148855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:13.148855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:13.148855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 641/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:13.153377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:13.250166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16579e3-7fdf-4c2f-b338-635ce687e474 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:13.283330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:13.283986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:13.284264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:13.284536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:13.285213 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:13.285512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:13.286855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:13.297772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 629/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:13.303377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:13.334622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:13.405234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012b17f-135a-48b6-a182-87c9fc1264f2 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:13.437465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:13.438085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:13.438361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:13.438630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:13.444952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:13.446380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:08:13.458424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:13.460059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:13.461739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 642/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:13.465713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:13.535940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:13.579146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d5b5-972e-4b62-9c68-5aa9aabb6f10 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:13.618014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88db32d-c8e9-4d69-82e1-1bbbd040197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:13.618618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88db32d-c8e9-4d69-82e1-1bbbd040197a None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:13.618899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88db32d-c8e9-4d69-82e1-1bbbd040197a None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:13.619173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88db32d-c8e9-4d69-82e1-1bbbd040197a None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:13.619941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88db32d-c8e9-4d69-82e1-1bbbd040197a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:13.620247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88db32d-c8e9-4d69-82e1-1bbbd040197a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:13.621669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88db32d-c8e9-4d69-82e1-1bbbd040197a None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:13.634051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 630/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:13.640678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:13.729353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:13.738358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ac6c9-e9ec-497b-a936-b71767fe8c43 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:13.772037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a093ae0-bff2-4195-b335-b5af88a69cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:13.772696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093ae0-bff2-4195-b335-b5af88a69cab None admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:13.772975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093ae0-bff2-4195-b335-b5af88a69cab None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:13.773252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093ae0-bff2-4195-b335-b5af88a69cab None admin] PATH_INFO: `/v3/projects/b44741ed50614da19d28eab38b8c9330/users/19e9ac125aab4b6bb623a02add505b41/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:13.775149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a093ae0-bff2-4195-b335-b5af88a69cab None admin] RBAC: Authorizing `identity:create_grant(project_id=b44741ed50614da19d28eab38b8c9330, user_id=19e9ac125aab4b6bb623a02add505b41, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:13.776619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a093ae0-bff2-4195-b335-b5af88a69cab None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:13.788846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 643/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 04:08:13 2022] PUT /identity/v3/projects/b44741ed50614da19d28eab38b8c9330/users/19e9ac125aab4b6bb623a02add505b41/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:08:15.761524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875fba-c3d0-4dd6-a1f0-3bd57b10192d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:15.761971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875fba-c3d0-4dd6-a1f0-3bd57b10192d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:15.762092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875fba-c3d0-4dd6-a1f0-3bd57b10192d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:15.763506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 631/1274] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:15.768608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dae02-2898-4150-8610-abc65bdd7dea None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:15.769024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dae02-2898-4150-8610-abc65bdd7dea None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:15.769165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dae02-2898-4150-8610-abc65bdd7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:15.787556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-230dae02-2898-4150-8610-abc65bdd7dea None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:15.788742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-230dae02-2898-4150-8610-abc65bdd7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:15.853104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 644/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:08:15.876690 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e875fba-c3d0-4dd6-a1f0-3bd57b10192d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:15.975617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e875fba-c3d0-4dd6-a1f0-3bd57b10192d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:15.996148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:16.014472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:16.015102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:16.015417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:16.015695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:16.025472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 04:08:16.030906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:16.032075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:16.033009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 632/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 04:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:16.038063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dae02-2898-4150-8610-abc65bdd7dea None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:16.118397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:16.136694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dae02-2898-4150-8610-abc65bdd7dea None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:16.169966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:16.170567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:16.170846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:16.171116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:16.171845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:16.172147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:16.173507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:16.181188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 645/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 04:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:16.187014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:16.285932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839b5d5-c80f-48ad-b907-b80297259c80 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:16.318098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:16.318717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:16.318993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:16.319288 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:16.329711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:16.331129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:16.346017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:16.347062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:16.348041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:16.348041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:16.348041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:16.348041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:16.348041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 633/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:16.352958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:16.451461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50933a9e-6c3b-4854-9387-aef69d660f9b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:16.486528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:16.487138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:16.487449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:16.487722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:16.488401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:16.488700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:16.490057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:16.501864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 646/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:16.507789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:16.539007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:16.607375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8e3e-87f7-4618-aec7-2852e5ce9d49 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:16.642006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:16.642627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:16.642902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:16.643171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:16.650431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:16.651879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 04:08:16.662936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:16.664105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:16.665299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 634/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:16.670087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:16.673826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:16.769493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23cef-28a1-4e6c-ba62-9fadf7dab683 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:16.802132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:16.802677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:16.802955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:16.803224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:16.804027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:16.804330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:16.805750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:16.822796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 647/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 04:08:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:16.829590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:16.916696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:16.926744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a28762-5ee6-46d4-b1cb-bdb6b9cbc129 None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:16.958829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:16.959453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:16.959732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:16.960004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:17.024268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:17.025726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:17.111585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:17.121714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 635/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 04:08:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 04:08:17.128426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:17.189024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:17.225549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92697f-a610-4a10-aab5-f3700944dc6b None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:17.259194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:17.259844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:17.260123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:17.260397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:17.270177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:17.271640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 04:08:17.286457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:17.287581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:17.288733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 04:08:17.288733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 04:08:17.288733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 04:08:17.288733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:17.288733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 648/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:17.293166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:17.388989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f024-f6ac-4e3c-b224-6ad1114b433f None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:17.422390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:17.422991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:17.423295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:17.423577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:17.424259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:17.424564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:17.425912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:17.437478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 636/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 04:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:17.443072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:17.543190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca3b6-4f8f-4fcc-9259-6b0ae0fba716 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:17.556160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:17.576770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:17.577397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:17.577680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:17.577958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:17.584407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:17.585847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 04:08:17.596914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:17.598008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: ERROR keystone.server.flask.application Jul 27 04:08:17.598980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 649/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 04:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:17.603934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:17.653325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:17.703115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2295796-cf76-4a55-a5a3-bb97921101bd None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:17.735992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22fb3c-da40-4c62-a48f-cdec2729f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:17.736607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22fb3c-da40-4c62-a48f-cdec2729f45c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:17.736890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22fb3c-da40-4c62-a48f-cdec2729f45c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:17.737167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22fb3c-da40-4c62-a48f-cdec2729f45c None admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:17.737911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22fb3c-da40-4c62-a48f-cdec2729f45c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:17.738220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22fb3c-da40-4c62-a48f-cdec2729f45c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:17.739691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22fb3c-da40-4c62-a48f-cdec2729f45c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:17.751626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 637/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 04:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:17.757884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:17.856963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb3910-739f-4a97-9028-f9eb31c8bbf3 None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:17.889730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dae1b8-2deb-46eb-8ae6-763788f5c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:17.890347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae1b8-2deb-46eb-8ae6-763788f5c63f None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:17.890632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae1b8-2deb-46eb-8ae6-763788f5c63f None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:17.890910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae1b8-2deb-46eb-8ae6-763788f5c63f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:17.891729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dae1b8-2deb-46eb-8ae6-763788f5c63f None admin] RBAC: Adding query filter params (role.id=bd9f5a9a33c44f42b039e5fe54e8230a, scope.project.id=b44741ed50614da19d28eab38b8c9330, user.id=19e9ac125aab4b6bb623a02add505b41) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:17.892049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dae1b8-2deb-46eb-8ae6-763788f5c63f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:17.893525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dae1b8-2deb-46eb-8ae6-763788f5c63f None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:17.899194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 650/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 04:08:17 2022] GET /identity/v3/role_assignments?user.id=19e9ac125aab4b6bb623a02add505b41&scope.project.id=b44741ed50614da19d28eab38b8c9330&role.id=bd9f5a9a33c44f42b039e5fe54e8230a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:19.917298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325e7b-ca6b-439b-afca-039f0e1733de None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:19.917863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325e7b-ca6b-439b-afca-039f0e1733de None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:19.917863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325e7b-ca6b-439b-afca-039f0e1733de None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:19.919843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 638/1288] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:19.924885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7073c-cfc1-4e48-98be-c7f2f49c0af9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:19.925283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7073c-cfc1-4e48-98be-c7f2f49c0af9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:19.925447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7073c-cfc1-4e48-98be-c7f2f49c0af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:19.943856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-44c7073c-cfc1-4e48-98be-c7f2f49c0af9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:19.945046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-44c7073c-cfc1-4e48-98be-c7f2f49c0af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:19.973507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:20.011302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 651/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:08:20.036507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325e7b-ca6b-439b-afca-039f0e1733de None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:20.137894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325e7b-ca6b-439b-afca-039f0e1733de None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:20.148607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:20.172784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:20.173408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:20.173687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:20.173956 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:20.174575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:20.175944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:20.184522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:20.185972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:20.186945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 639/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:08:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 04:08:20.192312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7073c-cfc1-4e48-98be-c7f2f49c0af9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:20.289197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7073c-cfc1-4e48-98be-c7f2f49c0af9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:20.321583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca7fd3-b28a-448a-a698-060de64e813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:20.322183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7fd3-b28a-448a-a698-060de64e813b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:20.322461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7fd3-b28a-448a-a698-060de64e813b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:20.322732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7fd3-b28a-448a-a698-060de64e813b None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:20.323420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca7fd3-b28a-448a-a698-060de64e813b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:20.323723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca7fd3-b28a-448a-a698-060de64e813b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:20.325116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca7fd3-b28a-448a-a698-060de64e813b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:20.330416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 652/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 04:08:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:08:20.336167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:20.432976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287527-5837-4da0-b0dd-f8d4333cfadc None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:20.468383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417668b0-124a-4199-9744-9550b952a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:20.469230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417668b0-124a-4199-9744-9550b952a1ea None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:20.469537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417668b0-124a-4199-9744-9550b952a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:20.469901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417668b0-124a-4199-9744-9550b952a1ea None admin] PATH_INFO: `/v3/services` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:20.470693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417668b0-124a-4199-9744-9550b952a1ea None admin] RBAC: Adding query filter params (type=placement) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:20.471039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417668b0-124a-4199-9744-9550b952a1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:20.472748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417668b0-124a-4199-9744-9550b952a1ea None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:20.478036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 640/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 04:08:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:22.455038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21a56-8189-4d2e-b951-5a15621c1ae8 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:22.455672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21a56-8189-4d2e-b951-5a15621c1ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:22.455672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21a56-8189-4d2e-b951-5a15621c1ae8 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:22.456973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 653/1293] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:22.462570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73def34-e637-429c-8d82-71a576f51c22 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:22.463118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73def34-e637-429c-8d82-71a576f51c22 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:22.463237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73def34-e637-429c-8d82-71a576f51c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:22.482147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f73def34-e637-429c-8d82-71a576f51c22 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:22.483352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f73def34-e637-429c-8d82-71a576f51c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:22.512849 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:22.551392 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 641/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:08:22.573279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b21a56-8189-4d2e-b951-5a15621c1ae8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:22.604187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:22.673006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b21a56-8189-4d2e-b951-5a15621c1ae8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:22.705498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceda05b-18aa-4999-8aa5-bc7443cdfb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:22.706044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda05b-18aa-4999-8aa5-bc7443cdfb7a None admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:22.706322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda05b-18aa-4999-8aa5-bc7443cdfb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:22.706593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda05b-18aa-4999-8aa5-bc7443cdfb7a None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:22.707304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceda05b-18aa-4999-8aa5-bc7443cdfb7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:22.708668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceda05b-18aa-4999-8aa5-bc7443cdfb7a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:22.727870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 654/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 04:08:22 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:08:24.784121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a381-0b6c-4cd6-bf19-3161f05a7b92 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:24.784623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a381-0b6c-4cd6-bf19-3161f05a7b92 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:24.784728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a381-0b6c-4cd6-bf19-3161f05a7b92 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:24.786040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 642/1296] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:24.791363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236c7c-1881-4a66-acab-72a45a72bcd9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:24.791775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236c7c-1881-4a66-acab-72a45a72bcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:24.791916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea236c7c-1881-4a66-acab-72a45a72bcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:24.810514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ea236c7c-1881-4a66-acab-72a45a72bcd9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:24.811736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ea236c7c-1881-4a66-acab-72a45a72bcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:24.883190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 655/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:08:24.905874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a381-0b6c-4cd6-bf19-3161f05a7b92 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:25.008532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a381-0b6c-4cd6-bf19-3161f05a7b92 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:25.041089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:25.041713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:25.041991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:25.042262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:25.042880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:25.044350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:25.053352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:25.054655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:25.055658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 643/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:08:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:25.060557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236c7c-1881-4a66-acab-72a45a72bcd9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:25.078814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:25.159594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea236c7c-1881-4a66-acab-72a45a72bcd9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:25.192419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:25.193035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:25.193318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:25.193597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:25.194273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:25.194581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:25.195986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:25.201640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 656/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 04:08:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:25.207874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:25.240368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:25.308029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae723e0-f487-43f3-b5fe-363415da212c None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:25.341855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e709846-cb99-446c-90c3-501f13008085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:25.342461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709846-cb99-446c-90c3-501f13008085 None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:25.342740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709846-cb99-446c-90c3-501f13008085 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:25.343007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709846-cb99-446c-90c3-501f13008085 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:25.343771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e709846-cb99-446c-90c3-501f13008085 None admin] RBAC: Adding query filter params (interface=public, service_id=e24425f928ca4f17a744ff6b739ae2b5, region_id=RegionOne) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:25.344117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e709846-cb99-446c-90c3-501f13008085 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:25.345452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e709846-cb99-446c-90c3-501f13008085 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:25.350271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 644/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 04:08:25 2022] GET /identity/v3/endpoints?service_id=e24425f928ca4f17a744ff6b739ae2b5&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:25.355993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:25.435882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:25.453968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2f90e-ce2a-4559-8fe1-dfb7c59447bf None admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:25.489275 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53d631-d4a8-4b97-aa91-abcb433be91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:25.489893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53d631-d4a8-4b97-aa91-abcb433be91b None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:25.490173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53d631-d4a8-4b97-aa91-abcb433be91b None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:25.490455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53d631-d4a8-4b97-aa91-abcb433be91b None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:25.491108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53d631-d4a8-4b97-aa91-abcb433be91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:25.492516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53d631-d4a8-4b97-aa91-abcb433be91b None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:25.500258 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 657/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 04:08:25 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:08:27.503400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ae2a1-24ce-4f64-81e6-60b2f192ab30 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:27.503938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ae2a1-24ce-4f64-81e6-60b2f192ab30 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:27.503938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ae2a1-24ce-4f64-81e6-60b2f192ab30 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:27.505294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 645/1302] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:08:27.510394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa355af-d2e6-4db1-bce2-0b83b4540b0e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:27.510778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa355af-d2e6-4db1-bce2-0b83b4540b0e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:27.510951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa355af-d2e6-4db1-bce2-0b83b4540b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:27.529948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8aa355af-d2e6-4db1-bce2-0b83b4540b0e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:08:27.531132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8aa355af-d2e6-4db1-bce2-0b83b4540b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:08:27.597154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 658/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:08:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 04:08:27.619317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ae2a1-24ce-4f64-81e6-60b2f192ab30 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:27.712547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:27.719478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ae2a1-24ce-4f64-81e6-60b2f192ab30 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:27.754255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:27.754834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:27.755117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:27.755426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:27.756054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:27.757405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 04:08:27.766313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 04:08:27.767536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application with Lock( Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self._enter() Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application return self.creator() Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application created_value = creator( Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: ERROR keystone.server.flask.application Jul 27 04:08:27.768419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 646/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 04:08:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 04:08:27.773624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa355af-d2e6-4db1-bce2-0b83b4540b0e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:27.849070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:27.872219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa355af-d2e6-4db1-bce2-0b83b4540b0e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:27.906160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3555-4a2a-4c7f-9749-f7b2d943fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:27.906773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3555-4a2a-4c7f-9749-f7b2d943fb7a None admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:27.907056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3555-4a2a-4c7f-9749-f7b2d943fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:27.907361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3555-4a2a-4c7f-9749-f7b2d943fb7a None admin] PATH_INFO: `/v3/services` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:27.908036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3555-4a2a-4c7f-9749-f7b2d943fb7a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:08:27.908344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3555-4a2a-4c7f-9749-f7b2d943fb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:27.909710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3555-4a2a-4c7f-9749-f7b2d943fb7a None admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:27.914749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 659/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 04:08:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:08:27.921555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:08:28.018407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e5119-9b53-4b57-8e2d-2dc960f292fe None admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:08:28.051535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a66fc3-bda7-43cc-bfca-ef63e6015134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:08:28.052133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66fc3-bda7-43cc-bfca-ef63e6015134 None admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:08:28.052501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66fc3-bda7-43cc-bfca-ef63e6015134 None admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:08:28.052784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66fc3-bda7-43cc-bfca-ef63e6015134 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:08:28.053481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a66fc3-bda7-43cc-bfca-ef63e6015134 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:08:28.054825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a66fc3-bda7-43cc-bfca-ef63e6015134 None admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:08:28.073603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 647/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:08:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:08:37.911727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=30 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:08:38.069345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:30.839093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468580e-0ed0-40db-9c3d-762ef0e35574 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:30.839698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468580e-0ed0-40db-9c3d-762ef0e35574 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:30.839698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468580e-0ed0-40db-9c3d-762ef0e35574 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:30.846739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3fce2-202b-4d9a-bfe5-fa12be359e05 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:30.847382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3fce2-202b-4d9a-bfe5-fa12be359e05 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:30.847382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3fce2-202b-4d9a-bfe5-fa12be359e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:30.850377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 660/1307] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:30.936335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9cd3fce2-202b-4d9a-bfe5-fa12be359e05 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:30.937577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9cd3fce2-202b-4d9a-bfe5-fa12be359e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:31.066360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 648/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:09:31.117166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fcb0-6d03-4e23-a100-37270c85987a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:31.117721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fcb0-6d03-4e23-a100-37270c85987a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:31.118173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fcb0-6d03-4e23-a100-37270c85987a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:31.120134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 661/1309] 10.222.0.48 () {54 vars in 965 bytes} [Wed Jul 27 04:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:31.126090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d1e4-0a9b-4551-adc5-70f63731c509 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:31.126386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d1e4-0a9b-4551-adc5-70f63731c509 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:31.126671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d1e4-0a9b-4551-adc5-70f63731c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:31.268451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-37b1d1e4-0a9b-4551-adc5-70f63731c509 None None] MFA Rules not processed for user `e90c842029d845bd8b4f12696354af78`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:31.269729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-37b1d1e4-0a9b-4551-adc5-70f63731c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:31.292042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:31.371595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 649/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Jul 27 04:09:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:31.380799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fcb0-6d03-4e23-a100-37270c85987a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:31.382442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-88b3fcb0-6d03-4e23-a100-37270c85987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:31.525739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fcb0-6d03-4e23-a100-37270c85987a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:31.606526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e35fe-c8dd-4e96-b263-4489e6e1ea3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:31.607055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e35fe-c8dd-4e96-b263-4489e6e1ea3f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:31.607356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e35fe-c8dd-4e96-b263-4489e6e1ea3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:31.607626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e35fe-c8dd-4e96-b263-4489e6e1ea3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:31.609228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-301e35fe-c8dd-4e96-b263-4489e6e1ea3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:31.665773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:31.726598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e35fe-c8dd-4e96-b263-4489e6e1ea3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:31.729487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e35fe-c8dd-4e96-b263-4489e6e1ea3f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:31.751780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 662/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:34.073308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6422-f211-4412-acf0-2817238e3a91 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:34.073856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6422-f211-4412-acf0-2817238e3a91 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:34.073856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6422-f211-4412-acf0-2817238e3a91 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:34.075391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 650/1312] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:34.080438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f904-fb82-49fb-b16e-718ddf25b0a0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:34.080846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f904-fb82-49fb-b16e-718ddf25b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:34.081008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f904-fb82-49fb-b16e-718ddf25b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:34.157052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-35d6f904-fb82-49fb-b16e-718ddf25b0a0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:34.158435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-35d6f904-fb82-49fb-b16e-718ddf25b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:34.263699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 663/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:34.302329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc6422-f211-4412-acf0-2817238e3a91 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:34.303872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e8cc6422-f211-4412-acf0-2817238e3a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:34.408609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc6422-f211-4412-acf0-2817238e3a91 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:34.482808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:34.485584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90798-fdeb-4c51-a742-8d7e07968503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:34.486374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90798-fdeb-4c51-a742-8d7e07968503 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:34.486834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90798-fdeb-4c51-a742-8d7e07968503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:34.487327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90798-fdeb-4c51-a742-8d7e07968503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:34.488953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3ca90798-fdeb-4c51-a742-8d7e07968503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:34.612724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca90798-fdeb-4c51-a742-8d7e07968503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:34.614169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca90798-fdeb-4c51-a742-8d7e07968503 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:34.640572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 651/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:36.964951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c85a5-94d8-4ac1-a54f-27cfb81c4393 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:36.965500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c85a5-94d8-4ac1-a54f-27cfb81c4393 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:36.965500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c85a5-94d8-4ac1-a54f-27cfb81c4393 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:36.966903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 664/1315] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:36.972693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94be71-fce5-4ded-9dba-090f3ef5d908 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:36.973236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94be71-fce5-4ded-9dba-090f3ef5d908 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:36.973387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94be71-fce5-4ded-9dba-090f3ef5d908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:37.040466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9a94be71-fce5-4ded-9dba-090f3ef5d908 None None] MFA Rules not processed for user `1a4eb63f190c4bfc82747aa57602f4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:37.041698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a94be71-fce5-4ded-9dba-090f3ef5d908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:37.093885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:37.139996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 652/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:37.180415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c85a5-94d8-4ac1-a54f-27cfb81c4393 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:37.181958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e20c85a5-94d8-4ac1-a54f-27cfb81c4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:37.191720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:37.291470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c85a5-94d8-4ac1-a54f-27cfb81c4393 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:37.363382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327518c-aa80-48f9-a91c-ac80291fd275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:37.363996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327518c-aa80-48f9-a91c-ac80291fd275 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:37.364279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327518c-aa80-48f9-a91c-ac80291fd275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:37.364560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327518c-aa80-48f9-a91c-ac80291fd275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:37.366184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3327518c-aa80-48f9-a91c-ac80291fd275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:37.427638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:37.475780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327518c-aa80-48f9-a91c-ac80291fd275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:37.477412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327518c-aa80-48f9-a91c-ac80291fd275 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:37.495112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 665/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:40.045220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1c949-dd40-4244-a0c2-2da16649c790 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:40.045745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1c949-dd40-4244-a0c2-2da16649c790 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:40.045871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1c949-dd40-4244-a0c2-2da16649c790 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:40.047143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 653/1318] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:40.052154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31801-6174-493c-95b4-483cd760d980 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:40.052604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31801-6174-493c-95b4-483cd760d980 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:40.052704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d31801-6174-493c-95b4-483cd760d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:40.119336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-46d31801-6174-493c-95b4-483cd760d980 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:40.120554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-46d31801-6174-493c-95b4-483cd760d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:40.214083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 666/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:40.253498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1c949-dd40-4244-a0c2-2da16649c790 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:40.255022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d9d1c949-dd40-4244-a0c2-2da16649c790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:40.360251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1c949-dd40-4244-a0c2-2da16649c790 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:40.433104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267ad0-0d60-4969-a50b-cf3bb0041186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:40.433724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267ad0-0d60-4969-a50b-cf3bb0041186 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:40.434011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267ad0-0d60-4969-a50b-cf3bb0041186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:40.434289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267ad0-0d60-4969-a50b-cf3bb0041186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:40.435942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-42267ad0-0d60-4969-a50b-cf3bb0041186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:40.443483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:40.545235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267ad0-0d60-4969-a50b-cf3bb0041186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:40.546684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267ad0-0d60-4969-a50b-cf3bb0041186 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:40.566358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 654/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:43.278026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964a8a-4f29-4c4c-afc1-f212edc48937 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:43.278590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964a8a-4f29-4c4c-afc1-f212edc48937 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:43.278687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964a8a-4f29-4c4c-afc1-f212edc48937 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:43.280102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 667/1321] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:43.285394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632525a-fced-4e5c-bccb-88654b44b048 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:43.285855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632525a-fced-4e5c-bccb-88654b44b048 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:43.286022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632525a-fced-4e5c-bccb-88654b44b048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:43.352764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4632525a-fced-4e5c-bccb-88654b44b048 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:43.353967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4632525a-fced-4e5c-bccb-88654b44b048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:43.417883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:43.460841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 655/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:43.499418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964a8a-4f29-4c4c-afc1-f212edc48937 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:43.501230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-62964a8a-4f29-4c4c-afc1-f212edc48937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:43.522086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:43.612246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964a8a-4f29-4c4c-afc1-f212edc48937 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:43.685940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568b4f8-ecc7-4db8-b24b-5d19a1232593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:43.686554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568b4f8-ecc7-4db8-b24b-5d19a1232593 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:43.686840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568b4f8-ecc7-4db8-b24b-5d19a1232593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:43.687113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568b4f8-ecc7-4db8-b24b-5d19a1232593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:43.688755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d568b4f8-ecc7-4db8-b24b-5d19a1232593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:43.761909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:43.804033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568b4f8-ecc7-4db8-b24b-5d19a1232593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:43.805526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568b4f8-ecc7-4db8-b24b-5d19a1232593 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:43.823246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 668/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:45.901900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382192e-fc7d-43c9-99b4-ecdb61642126 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:45.902420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382192e-fc7d-43c9-99b4-ecdb61642126 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:45.902420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382192e-fc7d-43c9-99b4-ecdb61642126 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:45.903955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 656/1324] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:45.909031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27c2df-eb82-4c62-b959-eb2b5ba430dd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:45.909445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27c2df-eb82-4c62-b959-eb2b5ba430dd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:45.909586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27c2df-eb82-4c62-b959-eb2b5ba430dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:45.974926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6d27c2df-eb82-4c62-b959-eb2b5ba430dd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:45.976171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6d27c2df-eb82-4c62-b959-eb2b5ba430dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:46.071035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 669/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:46.107446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382192e-fc7d-43c9-99b4-ecdb61642126 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:46.109064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5382192e-fc7d-43c9-99b4-ecdb61642126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:46.213308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382192e-fc7d-43c9-99b4-ecdb61642126 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:46.290084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e004b1-7234-4c5f-b79b-72412596e05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:46.290705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e004b1-7234-4c5f-b79b-72412596e05e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:46.290989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e004b1-7234-4c5f-b79b-72412596e05e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:46.291291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e004b1-7234-4c5f-b79b-72412596e05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:46.292891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c3e004b1-7234-4c5f-b79b-72412596e05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:46.309816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:46.403063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e004b1-7234-4c5f-b79b-72412596e05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:46.404540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e004b1-7234-4c5f-b79b-72412596e05e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:46.422665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 657/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:48.633313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5344-1ccb-4d3b-a605-d64920ef8457 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:48.633829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5344-1ccb-4d3b-a605-d64920ef8457 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:48.633829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e5344-1ccb-4d3b-a605-d64920ef8457 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:48.635152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 670/1327] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:48.640755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21dd59-6408-4b97-869e-c462562665fa None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:48.641228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21dd59-6408-4b97-869e-c462562665fa None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:48.641308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21dd59-6408-4b97-869e-c462562665fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:48.710749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9b21dd59-6408-4b97-869e-c462562665fa None None] MFA Rules not processed for user `1a4eb63f190c4bfc82747aa57602f4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:48.711995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9b21dd59-6408-4b97-869e-c462562665fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:48.785153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:48.817220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 658/1328] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:48.856001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5344-1ccb-4d3b-a605-d64920ef8457 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:48.857561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-156e5344-1ccb-4d3b-a605-d64920ef8457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:48.890040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:48.964420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e5344-1ccb-4d3b-a605-d64920ef8457 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:49.043631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc616a59-2544-4141-bb96-f7c735ff7811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:49.044254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616a59-2544-4141-bb96-f7c735ff7811 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:49.044537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616a59-2544-4141-bb96-f7c735ff7811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:49.044812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616a59-2544-4141-bb96-f7c735ff7811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:49.046436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bc616a59-2544-4141-bb96-f7c735ff7811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:49.138887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:49.171191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc616a59-2544-4141-bb96-f7c735ff7811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:49.173445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc616a59-2544-4141-bb96-f7c735ff7811 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:49.201204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 671/1329] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:51.464895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a584-bbe8-4d4c-8f48-7aa6a5a8c041 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:51.465436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a584-bbe8-4d4c-8f48-7aa6a5a8c041 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:51.465436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a584-bbe8-4d4c-8f48-7aa6a5a8c041 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:51.466764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 659/1330] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:51.472096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06e985-9394-49f3-be4c-3c7ff418eaa4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:51.472503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06e985-9394-49f3-be4c-3c7ff418eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:51.472650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06e985-9394-49f3-be4c-3c7ff418eaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:51.537733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dc06e985-9394-49f3-be4c-3c7ff418eaa4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:51.539490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dc06e985-9394-49f3-be4c-3c7ff418eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:51.634381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 672/1331] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:51.670840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486a584-bbe8-4d4c-8f48-7aa6a5a8c041 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:51.672414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3486a584-bbe8-4d4c-8f48-7aa6a5a8c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:51.775191 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486a584-bbe8-4d4c-8f48-7aa6a5a8c041 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:51.847956 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886638bb-fa84-4ee3-b141-35c0e6b280fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:51.848564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886638bb-fa84-4ee3-b141-35c0e6b280fb service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:51.848838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886638bb-fa84-4ee3-b141-35c0e6b280fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:51.849109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886638bb-fa84-4ee3-b141-35c0e6b280fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:51.850696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-886638bb-fa84-4ee3-b141-35c0e6b280fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:51.878194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:51.970424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886638bb-fa84-4ee3-b141-35c0e6b280fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:51.971913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886638bb-fa84-4ee3-b141-35c0e6b280fb service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:51.989942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 660/1332] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:54.046917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d19f-5e81-43a0-81ad-0b28ee962a2d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:54.047541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d19f-5e81-43a0-81ad-0b28ee962a2d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:54.047541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d19f-5e81-43a0-81ad-0b28ee962a2d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:54.048863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 673/1333] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:54.054530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6b36a-6ef6-4950-a692-c93dc714eefd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:54.054950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6b36a-6ef6-4950-a692-c93dc714eefd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:54.055183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6b36a-6ef6-4950-a692-c93dc714eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:54.120352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-43d6b36a-6ef6-4950-a692-c93dc714eefd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:54.121561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-43d6b36a-6ef6-4950-a692-c93dc714eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:54.195571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:54.221768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 661/1334] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:54.262418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d19f-5e81-43a0-81ad-0b28ee962a2d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:54.264042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-db15d19f-5e81-43a0-81ad-0b28ee962a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:54.304829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:54.368053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d19f-5e81-43a0-81ad-0b28ee962a2d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:54.441346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e493529-8986-4e41-b919-2d040998a0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:54.441952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e493529-8986-4e41-b919-2d040998a0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:54.442232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e493529-8986-4e41-b919-2d040998a0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:54.442506 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e493529-8986-4e41-b919-2d040998a0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:54.444149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9e493529-8986-4e41-b919-2d040998a0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:54.538104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:54.564572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e493529-8986-4e41-b919-2d040998a0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:54.565950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e493529-8986-4e41-b919-2d040998a0d1 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:54.583896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 674/1335] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:09:56.943799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8a711-5ef7-4bce-8880-4b82fd73a67f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:56.944328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8a711-5ef7-4bce-8880-4b82fd73a67f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:56.944328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8a711-5ef7-4bce-8880-4b82fd73a67f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:56.946201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 662/1336] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:09:56.951519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdb6fb-46f3-4753-a74d-5572deb08e1a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:56.951953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdb6fb-46f3-4753-a74d-5572deb08e1a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:56.952084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdb6fb-46f3-4753-a74d-5572deb08e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:57.018856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-facdb6fb-46f3-4753-a74d-5572deb08e1a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:09:57.020105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-facdb6fb-46f3-4753-a74d-5572deb08e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:57.114743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 675/1337] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:09:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:09:57.151601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8a711-5ef7-4bce-8880-4b82fd73a67f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:09:57.153146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a9d8a711-5ef7-4bce-8880-4b82fd73a67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:57.254385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8a711-5ef7-4bce-8880-4b82fd73a67f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:09:57.327471 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3d82-5e3c-4ab4-bdb1-d2a892a9b254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:09:57.328077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3d82-5e3c-4ab4-bdb1-d2a892a9b254 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:09:57.328358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3d82-5e3c-4ab4-bdb1-d2a892a9b254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:09:57.328633 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3d82-5e3c-4ab4-bdb1-d2a892a9b254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:09:57.330247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ad6f3d82-5e3c-4ab4-bdb1-d2a892a9b254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:09:57.366719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:09:57.439698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f3d82-5e3c-4ab4-bdb1-d2a892a9b254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:09:57.441145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f3d82-5e3c-4ab4-bdb1-d2a892a9b254 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:09:57.458543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 663/1338] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:09:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:01.383812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d949f24-73a1-4449-bd28-09f3279cf70e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:01.384352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d949f24-73a1-4449-bd28-09f3279cf70e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:01.384352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d949f24-73a1-4449-bd28-09f3279cf70e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:01.385791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 676/1339] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:10:01.390948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c2f6-0c91-45f5-9d9c-64e73e7e4fec None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:01.391374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c2f6-0c91-45f5-9d9c-64e73e7e4fec None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:01.391547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c2f6-0c91-45f5-9d9c-64e73e7e4fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:01.462872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ee45c2f6-0c91-45f5-9d9c-64e73e7e4fec None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:01.464180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ee45c2f6-0c91-45f5-9d9c-64e73e7e4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:01.550200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:01.562412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 664/1340] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:01.615820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2346-ef06-4653-8312-d5afd0f4e7a5 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:01.616753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2346-ef06-4653-8312-d5afd0f4e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:01.617091 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2346-ef06-4653-8312-d5afd0f4e7a5 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:01.618604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 677/1341] 10.222.0.48 () {54 vars in 965 bytes} [Wed Jul 27 04:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:01.624913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460c97-881e-4463-85fe-9554b2eb6892 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:01.625207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460c97-881e-4463-85fe-9554b2eb6892 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:01.625489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460c97-881e-4463-85fe-9554b2eb6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:01.702418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-88460c97-881e-4463-85fe-9554b2eb6892 None None] MFA Rules not processed for user `e90c842029d845bd8b4f12696354af78`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:01.703566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-88460c97-881e-4463-85fe-9554b2eb6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:01.782593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 665/1342] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Jul 27 04:10:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:01.791714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2346-ef06-4653-8312-d5afd0f4e7a5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:01.793240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-029d2346-ef06-4653-8312-d5afd0f4e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:01.842427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:01.898792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2346-ef06-4653-8312-d5afd0f4e7a5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:01.972408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd1204-3e00-4ec9-a9ff-8b8d374ce74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:01.972972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1204-3e00-4ec9-a9ff-8b8d374ce74e service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:01.973255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1204-3e00-4ec9-a9ff-8b8d374ce74e service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:01.973535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1204-3e00-4ec9-a9ff-8b8d374ce74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:01.975135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a7cd1204-3e00-4ec9-a9ff-8b8d374ce74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:02.068338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:02.085315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd1204-3e00-4ec9-a9ff-8b8d374ce74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:02.086769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd1204-3e00-4ec9-a9ff-8b8d374ce74e service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:02.105140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 678/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:05.333464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e20e0-0a8f-4182-8d49-228b235ae180 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:05.334020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e20e0-0a8f-4182-8d49-228b235ae180 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:05.334020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e20e0-0a8f-4182-8d49-228b235ae180 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:05.336395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 666/1344] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:05.342216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325331-a296-435f-87f0-7d897b74c617 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:05.342780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325331-a296-435f-87f0-7d897b74c617 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:05.342883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325331-a296-435f-87f0-7d897b74c617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:05.412650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ca325331-a296-435f-87f0-7d897b74c617 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:05.414932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ca325331-a296-435f-87f0-7d897b74c617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:05.516623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 679/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:05.554850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e20e0-0a8f-4182-8d49-228b235ae180 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:05.556536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-464e20e0-0a8f-4182-8d49-228b235ae180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:05.648163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:05.668240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e20e0-0a8f-4182-8d49-228b235ae180 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:05.747420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9207eb-32fa-4620-946b-1173483b6d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:05.748047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9207eb-32fa-4620-946b-1173483b6d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:05.748327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9207eb-32fa-4620-946b-1173483b6d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:05.748599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9207eb-32fa-4620-946b-1173483b6d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:05.750456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a9207eb-32fa-4620-946b-1173483b6d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:05.864535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9207eb-32fa-4620-946b-1173483b6d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:05.866019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9207eb-32fa-4620-946b-1173483b6d60 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:05.885506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 667/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:10.084840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652a83-58cf-4f47-8d66-025afd84b6e6 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:10.085395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652a83-58cf-4f47-8d66-025afd84b6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:10.085584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652a83-58cf-4f47-8d66-025afd84b6e6 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:10.087032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 680/1347] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:10.092524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57acaff-3ab4-4b4a-b998-942b60618027 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:10.092965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57acaff-3ab4-4b4a-b998-942b60618027 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:10.093150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57acaff-3ab4-4b4a-b998-942b60618027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:10.109092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:10.162087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b57acaff-3ab4-4b4a-b998-942b60618027 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:10.164848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b57acaff-3ab4-4b4a-b998-942b60618027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:10.265772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 668/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:10.304864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652a83-58cf-4f47-8d66-025afd84b6e6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:10.306399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ff652a83-58cf-4f47-8d66-025afd84b6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:10.363497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:10.408995 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652a83-58cf-4f47-8d66-025afd84b6e6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:10.483712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd312a5-eb7e-46b9-b3be-eef2eb246ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:10.484338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd312a5-eb7e-46b9-b3be-eef2eb246ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:10.484622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd312a5-eb7e-46b9-b3be-eef2eb246ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:10.484899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd312a5-eb7e-46b9-b3be-eef2eb246ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:10.486516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8bd312a5-eb7e-46b9-b3be-eef2eb246ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:10.592493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:10.596722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd312a5-eb7e-46b9-b3be-eef2eb246ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:10.598282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd312a5-eb7e-46b9-b3be-eef2eb246ad1 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:10.618344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 681/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:15.456739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c484c7-b727-41c3-b2c9-c3317d34f0f9 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:15.457586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c484c7-b727-41c3-b2c9-c3317d34f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:15.458019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c484c7-b727-41c3-b2c9-c3317d34f0f9 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:15.460820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 669/1350] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:10:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:15.465541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8edcd-3d19-4072-8a9f-568f970d0dee None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:15.465959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8edcd-3d19-4072-8a9f-568f970d0dee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:15.466157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8edcd-3d19-4072-8a9f-568f970d0dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:15.618446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-50d8edcd-3d19-4072-8a9f-568f970d0dee None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:15.620322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-50d8edcd-3d19-4072-8a9f-568f970d0dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:15.740146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 682/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:19.867098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7792-e49e-4899-a151-b775043950eb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:19.868613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7792-e49e-4899-a151-b775043950eb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:19.869238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7792-e49e-4899-a151-b775043950eb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:19.872642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 670/1352] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:10:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:19.877667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79d03-b0c5-47dc-9cd5-c2d6ea8f0af0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:19.878547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79d03-b0c5-47dc-9cd5-c2d6ea8f0af0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:19.879040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79d03-b0c5-47dc-9cd5-c2d6ea8f0af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:19.939645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:19.965183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-40e79d03-b0c5-47dc-9cd5-c2d6ea8f0af0 None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:19.966398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-40e79d03-b0c5-47dc-9cd5-c2d6ea8f0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:20.080560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 683/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:10:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:20.263960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=59 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:21.441172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0e80-5411-4fe7-bfa8-0edd3a0be5ed None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:21.441866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0e80-5411-4fe7-bfa8-0edd3a0be5ed None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:21.441866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0e80-5411-4fe7-bfa8-0edd3a0be5ed None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:21.443951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 671/1354] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:21.448667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61749-589d-46b4-bce7-86d812baf54e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:21.449095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61749-589d-46b4-bce7-86d812baf54e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:21.449233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61749-589d-46b4-bce7-86d812baf54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:21.526570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-55e61749-589d-46b4-bce7-86d812baf54e None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:21.527805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-55e61749-589d-46b4-bce7-86d812baf54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:21.569556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:21.636612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 684/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:10:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:25.132177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9654-35c2-434d-844d-1ff8dda25371 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:25.132735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9654-35c2-434d-844d-1ff8dda25371 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:25.132735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9654-35c2-434d-844d-1ff8dda25371 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:25.134144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 672/1356] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:25.140208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8dd28-993b-44ea-a076-cc17afa0c3b5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:25.140735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8dd28-993b-44ea-a076-cc17afa0c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:25.141220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8dd28-993b-44ea-a076-cc17afa0c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:25.215359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0cf8dd28-993b-44ea-a076-cc17afa0c3b5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:25.216701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0cf8dd28-993b-44ea-a076-cc17afa0c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:25.320043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 685/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:25.377782 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9813-56b9-454b-a04e-1c366eff59d3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:25.378161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9813-56b9-454b-a04e-1c366eff59d3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:25.378653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9813-56b9-454b-a04e-1c366eff59d3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:25.381624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 673/1358] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 04:10:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:25.393285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dbe5f-1d66-40e6-b92d-99fdae57fc58 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:25.393848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dbe5f-1d66-40e6-b92d-99fdae57fc58 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:25.394672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dbe5f-1d66-40e6-b92d-99fdae57fc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:25.414523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:25.480002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ae8dbe5f-1d66-40e6-b92d-99fdae57fc58 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:25.481448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ae8dbe5f-1d66-40e6-b92d-99fdae57fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:25.604871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 686/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 04:10:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:10:25.612554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe9813-56b9-454b-a04e-1c366eff59d3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:25.614048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0cbe9813-56b9-454b-a04e-1c366eff59d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:25.778826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe9813-56b9-454b-a04e-1c366eff59d3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:25.856942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:25.900593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c8dbe-29d8-41dd-bcc9-8ee28083dfe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:25.901390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8dbe-29d8-41dd-bcc9-8ee28083dfe8 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:25.901773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8dbe-29d8-41dd-bcc9-8ee28083dfe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:25.902151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8dbe-29d8-41dd-bcc9-8ee28083dfe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:25.903923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ad3c8dbe-29d8-41dd-bcc9-8ee28083dfe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:26.002909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c8dbe-29d8-41dd-bcc9-8ee28083dfe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:26.004655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c8dbe-29d8-41dd-bcc9-8ee28083dfe8 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:26.025889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 674/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:28.298708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b0826-3b64-4380-a087-59da7e10b0e1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:28.299288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b0826-3b64-4380-a087-59da7e10b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:28.299288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b0826-3b64-4380-a087-59da7e10b0e1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:28.300636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 687/1361] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:28.306644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31750f-2fc9-4fe6-8b45-d95f76b096f5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:28.307084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31750f-2fc9-4fe6-8b45-d95f76b096f5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:28.307417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31750f-2fc9-4fe6-8b45-d95f76b096f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:28.378067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7f31750f-2fc9-4fe6-8b45-d95f76b096f5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:28.379429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7f31750f-2fc9-4fe6-8b45-d95f76b096f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:28.422219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:28.500067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 675/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:28.550906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b0826-3b64-4380-a087-59da7e10b0e1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:28.553024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-db3b0826-3b64-4380-a087-59da7e10b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:28.625867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:28.748584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b0826-3b64-4380-a087-59da7e10b0e1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:28.871675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35a34a-483f-4f63-b853-a41a15fdf759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:28.872298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35a34a-483f-4f63-b853-a41a15fdf759 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:28.872839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35a34a-483f-4f63-b853-a41a15fdf759 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:28.873115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35a34a-483f-4f63-b853-a41a15fdf759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:28.874736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3d35a34a-483f-4f63-b853-a41a15fdf759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:28.897648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:28.967647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35a34a-483f-4f63-b853-a41a15fdf759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:28.969265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35a34a-483f-4f63-b853-a41a15fdf759 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:28.988910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 688/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:31.392304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470444cb-368f-4a20-90f0-166dc32363f8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:31.392856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470444cb-368f-4a20-90f0-166dc32363f8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:31.392856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470444cb-368f-4a20-90f0-166dc32363f8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:31.394209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 676/1364] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:31.399678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c154-cf62-49d2-842f-67cc6aa209ea None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:31.400143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c154-cf62-49d2-842f-67cc6aa209ea None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:31.400228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c154-cf62-49d2-842f-67cc6aa209ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:31.501723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6fe7c154-cf62-49d2-842f-67cc6aa209ea None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:31.502886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6fe7c154-cf62-49d2-842f-67cc6aa209ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:31.606799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:31.611322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 689/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:31.655561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ee60b-ea3c-482a-bb21-11a5c0a0e9cc None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:31.656142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ee60b-ea3c-482a-bb21-11a5c0a0e9cc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:31.656608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ee60b-ea3c-482a-bb21-11a5c0a0e9cc None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:31.658413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 677/1366] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 04:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:31.664584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683c82-d3e4-446d-8d2c-828f5d53c05d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:31.664943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683c82-d3e4-446d-8d2c-828f5d53c05d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:31.665288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683c82-d3e4-446d-8d2c-828f5d53c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:31.763459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c0683c82-d3e4-446d-8d2c-828f5d53c05d None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:31.764665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c0683c82-d3e4-446d-8d2c-828f5d53c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:31.893916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 690/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 04:10:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:31.902259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ee60b-ea3c-482a-bb21-11a5c0a0e9cc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:31.904429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-617ee60b-ea3c-482a-bb21-11a5c0a0e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:32.072759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ee60b-ea3c-482a-bb21-11a5c0a0e9cc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:32.093626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:32.194773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5514-8044-42d5-a511-99e92df27a3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:32.195424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5514-8044-42d5-a511-99e92df27a3b service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:32.195711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5514-8044-42d5-a511-99e92df27a3b service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:32.195988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5514-8044-42d5-a511-99e92df27a3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:32.197611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b91e5514-8044-42d5-a511-99e92df27a3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:32.295825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5514-8044-42d5-a511-99e92df27a3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:32.297854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5514-8044-42d5-a511-99e92df27a3b service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:32.322686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 678/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:33.203628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c2291-426e-4f9d-b2cc-f25edffcd72f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:33.204166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c2291-426e-4f9d-b2cc-f25edffcd72f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:33.204166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c2291-426e-4f9d-b2cc-f25edffcd72f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:33.205628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 691/1369] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:33.211176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e677f-fdca-486f-8f79-2f2b0851cea3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:33.211664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e677f-fdca-486f-8f79-2f2b0851cea3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:33.211755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e677f-fdca-486f-8f79-2f2b0851cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:33.244833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:33.281613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f90e677f-fdca-486f-8f79-2f2b0851cea3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:33.282823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f90e677f-fdca-486f-8f79-2f2b0851cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:33.383779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 679/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:33.730523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09fa4d-d7a4-4f53-b073-051b416b881d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:33.730523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09fa4d-d7a4-4f53-b073-051b416b881d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:33.733897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09fa4d-d7a4-4f53-b073-051b416b881d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:33.733897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 692/1371] 10.222.0.48 () {54 vars in 964 bytes} [Wed Jul 27 04:10:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:33.740250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a677d3-4496-4029-a15a-b97fc33c1d33 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:33.740855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a677d3-4496-4029-a15a-b97fc33c1d33 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:33.741292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a677d3-4496-4029-a15a-b97fc33c1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:33.828588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-19a677d3-4496-4029-a15a-b97fc33c1d33 None None] MFA Rules not processed for user `046b235e211744b0bfe631e0acf4d6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:33.829958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-19a677d3-4496-4029-a15a-b97fc33c1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:33.882079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:33.914702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 680/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Jul 27 04:10:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:33.922588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09fa4d-d7a4-4f53-b073-051b416b881d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:33.924148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3b09fa4d-d7a4-4f53-b073-051b416b881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:33.979368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:34.040596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09fa4d-d7a4-4f53-b073-051b416b881d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:34.117665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f04e0-3785-4132-a3ba-04f8401c75ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:34.118462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f04e0-3785-4132-a3ba-04f8401c75ab service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:34.118842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f04e0-3785-4132-a3ba-04f8401c75ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:34.119213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f04e0-3785-4132-a3ba-04f8401c75ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:34.120999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-004f04e0-3785-4132-a3ba-04f8401c75ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:34.223460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:34.238215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f04e0-3785-4132-a3ba-04f8401c75ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:34.240037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f04e0-3785-4132-a3ba-04f8401c75ab service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:34.260232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 693/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:34.447071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c899-159f-427e-a282-1973183f50e8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:34.447566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c899-159f-427e-a282-1973183f50e8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:34.447752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4c899-159f-427e-a282-1973183f50e8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:34.449037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 681/1374] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:34.456446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9690e-7966-4075-804d-6604c90936e6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:34.456446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9690e-7966-4075-804d-6604c90936e6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:34.456446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9690e-7966-4075-804d-6604c90936e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:34.549086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d3b9690e-7966-4075-804d-6604c90936e6 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:34.552500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d3b9690e-7966-4075-804d-6604c90936e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:34.691592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 694/1375] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:34.731818 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4c899-159f-427e-a282-1973183f50e8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:34.733477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0ed4c899-159f-427e-a282-1973183f50e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:34.885683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4c899-159f-427e-a282-1973183f50e8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:34.939158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:35.004802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839b51b-2ed5-4de9-9069-0e66d2230b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:35.005357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839b51b-2ed5-4de9-9069-0e66d2230b22 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:35.005641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839b51b-2ed5-4de9-9069-0e66d2230b22 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:35.005919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839b51b-2ed5-4de9-9069-0e66d2230b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:35.007568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1839b51b-2ed5-4de9-9069-0e66d2230b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:35.099106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839b51b-2ed5-4de9-9069-0e66d2230b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:35.100775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839b51b-2ed5-4de9-9069-0e66d2230b22 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:35.119305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 682/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:37.170626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775cfd-9b88-48d0-8d71-7325ee6bb78c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:37.171144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775cfd-9b88-48d0-8d71-7325ee6bb78c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:37.171229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775cfd-9b88-48d0-8d71-7325ee6bb78c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:37.172620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 695/1377] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:37.179481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46b226-b698-4e9d-9609-c1f36a576061 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:37.179928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46b226-b698-4e9d-9609-c1f36a576061 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:37.180234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46b226-b698-4e9d-9609-c1f36a576061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:37.259508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fb46b226-b698-4e9d-9609-c1f36a576061 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:37.260641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fb46b226-b698-4e9d-9609-c1f36a576061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:37.267464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:37.360213 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 683/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:37.404872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775cfd-9b88-48d0-8d71-7325ee6bb78c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:37.406486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-62775cfd-9b88-48d0-8d71-7325ee6bb78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:37.474407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:37.573726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775cfd-9b88-48d0-8d71-7325ee6bb78c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:37.720513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b82f7-1bb2-403d-b073-1e9f82a6c47c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:37.724578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b82f7-1bb2-403d-b073-1e9f82a6c47c service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:37.724578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b82f7-1bb2-403d-b073-1e9f82a6c47c service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:37.724578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b82f7-1bb2-403d-b073-1e9f82a6c47c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:37.724912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-348b82f7-1bb2-403d-b073-1e9f82a6c47c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:37.751536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:37.834465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b82f7-1bb2-403d-b073-1e9f82a6c47c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:37.836196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b82f7-1bb2-403d-b073-1e9f82a6c47c service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:37.855338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 696/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:39.902117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0137-d80b-4d74-9f9c-4c1791ee7082 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:39.902644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0137-d80b-4d74-9f9c-4c1791ee7082 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:39.902758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0137-d80b-4d74-9f9c-4c1791ee7082 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:39.904237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 684/1380] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:39.909351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda181-b47c-4fe9-a06e-433862867dbb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:39.909785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda181-b47c-4fe9-a06e-433862867dbb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:39.909889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda181-b47c-4fe9-a06e-433862867dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:39.982662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a2eda181-b47c-4fe9-a06e-433862867dbb None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:39.984115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a2eda181-b47c-4fe9-a06e-433862867dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:40.093621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:40.107312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 697/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:40.150266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0137-d80b-4d74-9f9c-4c1791ee7082 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:40.151831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-859b0137-d80b-4d74-9f9c-4c1791ee7082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:40.296342 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:40.307547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0137-d80b-4d74-9f9c-4c1791ee7082 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:40.426388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3228fd-9ca9-47d1-8cc9-c819b93d98e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:40.427008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3228fd-9ca9-47d1-8cc9-c819b93d98e3 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:40.427310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3228fd-9ca9-47d1-8cc9-c819b93d98e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:40.427587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3228fd-9ca9-47d1-8cc9-c819b93d98e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:40.429235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0b3228fd-9ca9-47d1-8cc9-c819b93d98e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:40.529404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3228fd-9ca9-47d1-8cc9-c819b93d98e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:40.531135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3228fd-9ca9-47d1-8cc9-c819b93d98e3 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:40.544926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:40.556079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 685/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:42.653263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512e760-0f64-4f06-a6ab-7e0b54ac4a5f None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:42.653820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512e760-0f64-4f06-a6ab-7e0b54ac4a5f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:42.653820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512e760-0f64-4f06-a6ab-7e0b54ac4a5f None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:42.655208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 698/1383] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:42.664384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead30c3-d6fc-4f62-9644-17df3480a211 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:42.664878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead30c3-d6fc-4f62-9644-17df3480a211 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:42.664995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead30c3-d6fc-4f62-9644-17df3480a211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:42.736060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3ead30c3-d6fc-4f62-9644-17df3480a211 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:42.737266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3ead30c3-d6fc-4f62-9644-17df3480a211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:42.845995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 686/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:10:42.900753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512e760-0f64-4f06-a6ab-7e0b54ac4a5f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:42.902273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7512e760-0f64-4f06-a6ab-7e0b54ac4a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:43.068983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512e760-0f64-4f06-a6ab-7e0b54ac4a5f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:43.151296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:43.200064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94723f-131a-4ec7-8db5-547a469f55d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:43.200686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94723f-131a-4ec7-8db5-547a469f55d3 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:43.200973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94723f-131a-4ec7-8db5-547a469f55d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:43.201245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94723f-131a-4ec7-8db5-547a469f55d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:43.202879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0f94723f-131a-4ec7-8db5-547a469f55d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:43.298060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94723f-131a-4ec7-8db5-547a469f55d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:43.300206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94723f-131a-4ec7-8db5-547a469f55d3 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:43.324071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 699/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:45.405335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8268-c889-437b-84e2-06b9f48afdbf None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:45.405900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8268-c889-437b-84e2-06b9f48afdbf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:45.406113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8268-c889-437b-84e2-06b9f48afdbf None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:45.408188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 687/1386] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:45.413805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b87a4-4af0-40ef-88d7-1dbb89e9c755 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:45.414406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b87a4-4af0-40ef-88d7-1dbb89e9c755 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:45.414406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b87a4-4af0-40ef-88d7-1dbb89e9c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:45.485005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9d3b87a4-4af0-40ef-88d7-1dbb89e9c755 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:45.486241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9d3b87a4-4af0-40ef-88d7-1dbb89e9c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:45.520381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:45.590085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 700/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:45.640007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8268-c889-437b-84e2-06b9f48afdbf None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:45.641613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-998b8268-c889-437b-84e2-06b9f48afdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:45.723690 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:45.804952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8268-c889-437b-84e2-06b9f48afdbf None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:45.938501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18616a6-6f3a-4222-82a9-e192b73054ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:45.939520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18616a6-6f3a-4222-82a9-e192b73054ed service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:45.939882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18616a6-6f3a-4222-82a9-e192b73054ed service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:45.940235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18616a6-6f3a-4222-82a9-e192b73054ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:45.943034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a18616a6-6f3a-4222-82a9-e192b73054ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:45.987920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:46.041426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18616a6-6f3a-4222-82a9-e192b73054ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:46.043054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18616a6-6f3a-4222-82a9-e192b73054ed service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:46.061641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 688/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:48.133613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8177ab-8f71-4d23-a159-b3591c8c4aa4 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:48.134163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8177ab-8f71-4d23-a159-b3591c8c4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:48.134260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8177ab-8f71-4d23-a159-b3591c8c4aa4 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:48.135673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 701/1389] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:48.140812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba499-55d6-4e9a-8ef1-eafc4057dc87 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:48.141264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba499-55d6-4e9a-8ef1-eafc4057dc87 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:48.141502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba499-55d6-4e9a-8ef1-eafc4057dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:48.207990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ca6ba499-55d6-4e9a-8ef1-eafc4057dc87 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:48.209249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ca6ba499-55d6-4e9a-8ef1-eafc4057dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:48.305367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 689/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:48.352885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8177ab-8f71-4d23-a159-b3591c8c4aa4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:48.354397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-df8177ab-8f71-4d23-a159-b3591c8c4aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:48.504145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8177ab-8f71-4d23-a159-b3591c8c4aa4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:48.521864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:48.621448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976695f7-eae7-43d6-8f04-6356fb0403c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:48.622323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976695f7-eae7-43d6-8f04-6356fb0403c6 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:48.622602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976695f7-eae7-43d6-8f04-6356fb0403c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:48.622881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976695f7-eae7-43d6-8f04-6356fb0403c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:48.624500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-976695f7-eae7-43d6-8f04-6356fb0403c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:48.712475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976695f7-eae7-43d6-8f04-6356fb0403c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:48.714072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976695f7-eae7-43d6-8f04-6356fb0403c6 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:48.732937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 702/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:49.300228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb82ee-c800-4405-bae8-499fa9ea5535 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:49.300890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb82ee-c800-4405-bae8-499fa9ea5535 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:49.301809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb82ee-c800-4405-bae8-499fa9ea5535 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:49.303320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 690/1392] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:49.308788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f89d2-5d3c-416a-a42e-0ac3220f88f6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:49.309526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f89d2-5d3c-416a-a42e-0ac3220f88f6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:49.309526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f89d2-5d3c-416a-a42e-0ac3220f88f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:49.340092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:49.393839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f28f89d2-5d3c-416a-a42e-0ac3220f88f6 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:49.396064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f28f89d2-5d3c-416a-a42e-0ac3220f88f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:49.525212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 703/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:49.588268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6491b94-d09f-41f4-9f01-5c32afd5f04d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:49.588554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6491b94-d09f-41f4-9f01-5c32afd5f04d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:49.588860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6491b94-d09f-41f4-9f01-5c32afd5f04d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:49.590262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 691/1394] 10.222.0.48 () {54 vars in 966 bytes} [Wed Jul 27 04:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:49.595512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04932d-062d-4677-9f92-dfa7388e6e15 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:49.595803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04932d-062d-4677-9f92-dfa7388e6e15 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:49.596081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04932d-062d-4677-9f92-dfa7388e6e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:49.676565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0f04932d-062d-4677-9f92-dfa7388e6e15 None None] MFA Rules not processed for user `c2d3a3a7c1f545e593e7956ec79f25ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:49.677786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0f04932d-062d-4677-9f92-dfa7388e6e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:49.722232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:49.772365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 704/1395] 10.222.0.48 () {58 vars in 1063 bytes} [Wed Jul 27 04:10:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:49.780099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6491b94-d09f-41f4-9f01-5c32afd5f04d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:49.781726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d6491b94-d09f-41f4-9f01-5c32afd5f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:49.797147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:49.892972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6491b94-d09f-41f4-9f01-5c32afd5f04d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:49.974470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaabf9b-7176-412e-ad1f-4827a6f45566 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:49.975093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabf9b-7176-412e-ad1f-4827a6f45566 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:49.975416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabf9b-7176-412e-ad1f-4827a6f45566 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:49.975698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabf9b-7176-412e-ad1f-4827a6f45566 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:49.977314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fdaabf9b-7176-412e-ad1f-4827a6f45566 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:50.046879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:50.088555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaabf9b-7176-412e-ad1f-4827a6f45566 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:50.089998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaabf9b-7176-412e-ad1f-4827a6f45566 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:50.108962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 692/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:50.853073 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f766-64f3-44ee-9069-37cd0b88d5b9 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:50.853680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f766-64f3-44ee-9069-37cd0b88d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:50.853680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f766-64f3-44ee-9069-37cd0b88d5b9 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:50.855046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 705/1397] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:50.860421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130b82-34d9-41a1-adc1-dc0c967d2a1c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:50.860825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130b82-34d9-41a1-adc1-dc0c967d2a1c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:50.861067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130b82-34d9-41a1-adc1-dc0c967d2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:50.869965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:50.870336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:50.870682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:50.930719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ff130b82-34d9-41a1-adc1-dc0c967d2a1c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:50.932031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ff130b82-34d9-41a1-adc1-dc0c967d2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:50.946459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:50.947707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:51.035787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 706/1398] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:10:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:10:51.037136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 693/1399] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:51.083525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:51.085222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:51.085681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcd3a-2a1c-4fca-96e4-0308ebaa7ee8 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:51.085979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcd3a-2a1c-4fca-96e4-0308ebaa7ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:51.086318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcd3a-2a1c-4fca-96e4-0308ebaa7ee8 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:51.087722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 694/1400] 10.222.0.48 () {54 vars in 943 bytes} [Wed Jul 27 04:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:10:51.094114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd83a44-f90a-478c-8982-1ef159b82e26 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:51.094478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd83a44-f90a-478c-8982-1ef159b82e26 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:51.094847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd83a44-f90a-478c-8982-1ef159b82e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:51.122272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:51.145210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:51.174703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fcd83a44-f90a-478c-8982-1ef159b82e26 None None] MFA Rules not processed for user `11cd9091a4654f5eb689e23061b6e52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:51.176112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fcd83a44-f90a-478c-8982-1ef159b82e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:51.200910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf3aa6-513b-417b-a77e-1ddec560708c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:51.329579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337af3eb-5eb5-44e0-90ed-ae385d8d8349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:51.330209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af3eb-5eb5-44e0-90ed-ae385d8d8349 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:51.330492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af3eb-5eb5-44e0-90ed-ae385d8d8349 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:51.330765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af3eb-5eb5-44e0-90ed-ae385d8d8349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:51.332503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-337af3eb-5eb5-44e0-90ed-ae385d8d8349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:51.390382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:51.414177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 695/1401] 10.222.0.48 () {58 vars in 1040 bytes} [Wed Jul 27 04:10:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:10:51.423532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd83a44-f90a-478c-8982-1ef159b82e26 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:51.427992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337af3eb-5eb5-44e0-90ed-ae385d8d8349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:51.429621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337af3eb-5eb5-44e0-90ed-ae385d8d8349 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:51.433314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd83a44-f90a-478c-8982-1ef159b82e26 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:51.448355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 707/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:51.509144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:51.551844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8a2b-ed58-4f4f-9b92-4fc0683cb881 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:51.552753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8a2b-ed58-4f4f-9b92-4fc0683cb881 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:51.553040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8a2b-ed58-4f4f-9b92-4fc0683cb881 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:51.553319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8a2b-ed58-4f4f-9b92-4fc0683cb881 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:51.555057 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-578e8a2b-ed58-4f4f-9b92-4fc0683cb881 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:51.648876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e8a2b-ed58-4f4f-9b92-4fc0683cb881 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:51.650440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e8a2b-ed58-4f4f-9b92-4fc0683cb881 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:51.658867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 696/1403] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:10:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 04:10:53.574491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc8f29-fca9-41ce-8765-670c2b1294a1 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:53.575111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc8f29-fca9-41ce-8765-670c2b1294a1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:53.575111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc8f29-fca9-41ce-8765-670c2b1294a1 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:53.576608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 708/1404] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:53.581891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153adec2-4add-4713-b2e0-86a94d99d1a2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:53.582389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153adec2-4add-4713-b2e0-86a94d99d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:53.582472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153adec2-4add-4713-b2e0-86a94d99d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:53.658258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-153adec2-4add-4713-b2e0-86a94d99d1a2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:53.660045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-153adec2-4add-4713-b2e0-86a94d99d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:53.729250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:53.776822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 697/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:53.825252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc8f29-fca9-41ce-8765-670c2b1294a1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:53.826702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0fcc8f29-fca9-41ce-8765-670c2b1294a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:53.995030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc8f29-fca9-41ce-8765-670c2b1294a1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:54.036834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:54.128006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1745719-81fc-438a-ac60-a316b0d320a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:54.128619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745719-81fc-438a-ac60-a316b0d320a1 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:54.128932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745719-81fc-438a-ac60-a316b0d320a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:54.129261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1745719-81fc-438a-ac60-a316b0d320a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:54.130915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b1745719-81fc-438a-ac60-a316b0d320a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:54.234584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1745719-81fc-438a-ac60-a316b0d320a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:54.236209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1745719-81fc-438a-ac60-a316b0d320a1 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:54.257684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 709/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:10:56.396152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069adb-5530-477d-a78d-10d4dde50ff3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:56.396759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069adb-5530-477d-a78d-10d4dde50ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:56.396759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069adb-5530-477d-a78d-10d4dde50ff3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:56.398251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 698/1407] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:10:56.403525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae88ef-f5ca-4843-bb16-d22f663d8a4c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:56.404359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae88ef-f5ca-4843-bb16-d22f663d8a4c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:56.404825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae88ef-f5ca-4843-bb16-d22f663d8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:56.456094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:56.478321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-44ae88ef-f5ca-4843-bb16-d22f663d8a4c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:10:56.479628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-44ae88ef-f5ca-4843-bb16-d22f663d8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:56.589497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 710/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:10:56.634917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069adb-5530-477d-a78d-10d4dde50ff3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:10:56.636496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0a069adb-5530-477d-a78d-10d4dde50ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:56.811950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069adb-5530-477d-a78d-10d4dde50ff3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:10:56.856662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:10:56.950381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b7715-a4ea-4c7d-9721-a30744587bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:10:56.952975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7715-a4ea-4c7d-9721-a30744587bb0 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:10:56.953277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7715-a4ea-4c7d-9721-a30744587bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:10:56.953560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7715-a4ea-4c7d-9721-a30744587bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:10:56.955239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-987b7715-a4ea-4c7d-9721-a30744587bb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:10:57.068660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b7715-a4ea-4c7d-9721-a30744587bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:10:57.070624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b7715-a4ea-4c7d-9721-a30744587bb0 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:10:57.090744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 699/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:06.587612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=48 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:07.088640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=79 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:13.705188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf8790-7336-45a3-8aee-1abd1efe8054 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:13.705766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf8790-7336-45a3-8aee-1abd1efe8054 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:13.705766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf8790-7336-45a3-8aee-1abd1efe8054 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:13.707239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 711/1410] 10.222.0.48 () {54 vars in 918 bytes} [Wed Jul 27 04:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:13.712558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38f1fe-0b8a-4541-aed0-876efb13c702 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:13.713023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38f1fe-0b8a-4541-aed0-876efb13c702 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:13.713130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38f1fe-0b8a-4541-aed0-876efb13c702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:13.788519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-da38f1fe-0b8a-4541-aed0-876efb13c702 None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:13.789713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-da38f1fe-0b8a-4541-aed0-876efb13c702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:13.896822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 700/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jul 27 04:11:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:13.911251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b062ec7-0379-403a-bbf6-85ad2b073c0d None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:13.911567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b062ec7-0379-403a-bbf6-85ad2b073c0d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:13.911845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b062ec7-0379-403a-bbf6-85ad2b073c0d None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:13.913192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 712/1412] 10.222.0.48 () {54 vars in 918 bytes} [Wed Jul 27 04:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:13.917784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42114447-8e08-4ee6-8cb9-b36aa6aadc1e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:13.918069 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42114447-8e08-4ee6-8cb9-b36aa6aadc1e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:13.918345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42114447-8e08-4ee6-8cb9-b36aa6aadc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:13.989030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:13.991886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-42114447-8e08-4ee6-8cb9-b36aa6aadc1e None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:13.993739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-42114447-8e08-4ee6-8cb9-b36aa6aadc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:14.108302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 701/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jul 27 04:11:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:11:16.585559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61b53-62fc-468f-8d18-90de0a530885 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:16.586154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61b53-62fc-468f-8d18-90de0a530885 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:16.586154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61b53-62fc-468f-8d18-90de0a530885 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:16.587510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:16.593003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dabc36-4c8c-4c7e-b483-8799d9b26272 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:16.593410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dabc36-4c8c-4c7e-b483-8799d9b26272 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:16.593543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dabc36-4c8c-4c7e-b483-8799d9b26272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:16.660508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f5dabc36-4c8c-4c7e-b483-8799d9b26272 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:16.661698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f5dabc36-4c8c-4c7e-b483-8799d9b26272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:16.714983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:16.757693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:16.799761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b61b53-62fc-468f-8d18-90de0a530885 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:16.802083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-33b61b53-62fc-468f-8d18-90de0a530885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:16.946270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b61b53-62fc-468f-8d18-90de0a530885 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:17.022173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:17.061601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6659500-b1c8-4290-ade2-b362b08e9934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:17.062218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6659500-b1c8-4290-ade2-b362b08e9934 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:17.062499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6659500-b1c8-4290-ade2-b362b08e9934 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:17.062772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6659500-b1c8-4290-ade2-b362b08e9934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:17.064429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c6659500-b1c8-4290-ade2-b362b08e9934 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:17.156643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6659500-b1c8-4290-ade2-b362b08e9934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:17.158233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6659500-b1c8-4290-ade2-b362b08e9934 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:17.176001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 714/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:18.090861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94463733-4082-44ca-a5ca-e40c91f1e2e6 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:18.091492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94463733-4082-44ca-a5ca-e40c91f1e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:18.091492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94463733-4082-44ca-a5ca-e40c91f1e2e6 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:18.092793 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:18.097836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8fd8-7e0b-4e22-a14f-9f8f562f57ea None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:18.098272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8fd8-7e0b-4e22-a14f-9f8f562f57ea None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:18.098418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8fd8-7e0b-4e22-a14f-9f8f562f57ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:18.172039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e08d8fd8-7e0b-4e22-a14f-9f8f562f57ea None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:18.173237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e08d8fd8-7e0b-4e22-a14f-9f8f562f57ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:18.200567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:18.271823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:18.422705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94463733-4082-44ca-a5ca-e40c91f1e2e6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:18.424154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-94463733-4082-44ca-a5ca-e40c91f1e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:18.571339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94463733-4082-44ca-a5ca-e40c91f1e2e6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:18.611560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:18.687016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e332a-9f1a-4d03-8a00-251484a22031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:18.687593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e332a-9f1a-4d03-8a00-251484a22031 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:18.687871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e332a-9f1a-4d03-8a00-251484a22031 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:18.688139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e332a-9f1a-4d03-8a00-251484a22031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:18.689718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-484e332a-9f1a-4d03-8a00-251484a22031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:18.781098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e332a-9f1a-4d03-8a00-251484a22031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:18.782703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e332a-9f1a-4d03-8a00-251484a22031 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:18.801126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 704/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:19.684844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802970-a1c4-4f18-8075-7af252af7a84 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:19.685395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802970-a1c4-4f18-8075-7af252af7a84 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:19.685494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802970-a1c4-4f18-8075-7af252af7a84 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:19.686787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:11:19.692230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4202d-2d37-4c0d-bae2-6c3adb614aef None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:19.692677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4202d-2d37-4c0d-bae2-6c3adb614aef None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:19.692783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4202d-2d37-4c0d-bae2-6c3adb614aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:19.746915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:19.770478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-25b4202d-2d37-4c0d-bae2-6c3adb614aef None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:19.771784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-25b4202d-2d37-4c0d-bae2-6c3adb614aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:19.867064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:20.023482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802970-a1c4-4f18-8075-7af252af7a84 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:20.024985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-55802970-a1c4-4f18-8075-7af252af7a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:20.169844 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802970-a1c4-4f18-8075-7af252af7a84 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:20.182281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:20.285297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377da12-ad52-491e-8c86-a98bace835f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:20.286111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377da12-ad52-491e-8c86-a98bace835f4 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:20.286414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377da12-ad52-491e-8c86-a98bace835f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:20.286688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377da12-ad52-491e-8c86-a98bace835f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:20.288331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4377da12-ad52-491e-8c86-a98bace835f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:20.376470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377da12-ad52-491e-8c86-a98bace835f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:20.378112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377da12-ad52-491e-8c86-a98bace835f4 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:20.396550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 717/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:11:21.259609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4ee7b-5c99-405f-84fe-49ced96ea91d None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:21.260213 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4ee7b-5c99-405f-84fe-49ced96ea91d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:21.260213 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4ee7b-5c99-405f-84fe-49ced96ea91d None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:21.261528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:21.266459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a2c1-5dc5-429c-a53e-54285a66dc88 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:21.266924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a2c1-5dc5-429c-a53e-54285a66dc88 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:21.267030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a2c1-5dc5-429c-a53e-54285a66dc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:21.286724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:21.342814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c3b1a2c1-5dc5-429c-a53e-54285a66dc88 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:21.344064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c3b1a2c1-5dc5-429c-a53e-54285a66dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:21.440164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:21.589377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4ee7b-5c99-405f-84fe-49ced96ea91d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:21.590908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ddc4ee7b-5c99-405f-84fe-49ced96ea91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:21.702310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:21.738010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4ee7b-5c99-405f-84fe-49ced96ea91d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:21.851649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79db6aa-dbe0-473f-be04-f5a74de9aba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:21.852181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db6aa-dbe0-473f-be04-f5a74de9aba6 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:21.852456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db6aa-dbe0-473f-be04-f5a74de9aba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:21.852726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db6aa-dbe0-473f-be04-f5a74de9aba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:21.854319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a79db6aa-dbe0-473f-be04-f5a74de9aba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:21.930284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:21.944492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79db6aa-dbe0-473f-be04-f5a74de9aba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:21.946075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79db6aa-dbe0-473f-be04-f5a74de9aba6 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:21.963819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 707/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:22.826496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956426-a5db-47ec-820f-6f076b2fbc49 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:22.827069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956426-a5db-47ec-820f-6f076b2fbc49 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:22.827069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956426-a5db-47ec-820f-6f076b2fbc49 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:22.828464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:22.833293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691bd0e-1cf9-4663-8d20-a988ff291b3e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:22.833686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691bd0e-1cf9-4663-8d20-a988ff291b3e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:22.833847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691bd0e-1cf9-4663-8d20-a988ff291b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:22.909247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2691bd0e-1cf9-4663-8d20-a988ff291b3e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:22.910378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2691bd0e-1cf9-4663-8d20-a988ff291b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:23.014103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:23.164450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4956426-a5db-47ec-820f-6f076b2fbc49 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:23.165875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b4956426-a5db-47ec-820f-6f076b2fbc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:23.248481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:23.311750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4956426-a5db-47ec-820f-6f076b2fbc49 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:23.424598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c3379-100d-4157-bdee-64ef0caa4204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:23.425138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c3379-100d-4157-bdee-64ef0caa4204 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:23.425416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c3379-100d-4157-bdee-64ef0caa4204 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:23.425688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c3379-100d-4157-bdee-64ef0caa4204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:23.427387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-261c3379-100d-4157-bdee-64ef0caa4204 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:23.474709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:23.516469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c3379-100d-4157-bdee-64ef0caa4204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:23.518077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c3379-100d-4157-bdee-64ef0caa4204 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:23.535876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 720/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:24.340728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b696-8af5-41a1-995d-cc4b0b5ecb5a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:24.341301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b696-8af5-41a1-995d-cc4b0b5ecb5a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:24.341301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b696-8af5-41a1-995d-cc4b0b5ecb5a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:24.342689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:24.347628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c0f4-0740-40da-88f7-b9fc795adec2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:24.348060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c0f4-0740-40da-88f7-b9fc795adec2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:24.348223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c0f4-0740-40da-88f7-b9fc795adec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:24.423347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5ad3c0f4-0740-40da-88f7-b9fc795adec2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:24.424553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5ad3c0f4-0740-40da-88f7-b9fc795adec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:24.521038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:24.673416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042b696-8af5-41a1-995d-cc4b0b5ecb5a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:24.674958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9042b696-8af5-41a1-995d-cc4b0b5ecb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:24.724303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:24.823591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042b696-8af5-41a1-995d-cc4b0b5ecb5a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:24.937239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0afab7-2e67-4739-8900-0f0c028c683f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:24.937878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afab7-2e67-4739-8900-0f0c028c683f service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:24.938161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afab7-2e67-4739-8900-0f0c028c683f service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:24.938432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0afab7-2e67-4739-8900-0f0c028c683f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:24.940055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cb0afab7-2e67-4739-8900-0f0c028c683f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:24.948013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:25.032054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afab7-2e67-4739-8900-0f0c028c683f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:25.033708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0afab7-2e67-4739-8900-0f0c028c683f service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:25.051127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 710/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:25.864163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2f16-1c25-4046-99d7-1db4ffc17e67 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:25.864722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2f16-1c25-4046-99d7-1db4ffc17e67 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:25.864722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2f16-1c25-4046-99d7-1db4ffc17e67 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:25.866079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:25.871003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e33e-0021-41c7-bafc-78432f7085c7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:25.871745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e33e-0021-41c7-bafc-78432f7085c7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:25.871845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e33e-0021-41c7-bafc-78432f7085c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:25.948062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8843e33e-0021-41c7-bafc-78432f7085c7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:25.949268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8843e33e-0021-41c7-bafc-78432f7085c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:26.016871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:26.046816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:26.198123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2f16-1c25-4046-99d7-1db4ffc17e67 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:26.199715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-31ff2f16-1c25-4046-99d7-1db4ffc17e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:26.217862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:26.344462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2f16-1c25-4046-99d7-1db4ffc17e67 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:26.431779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:26.458497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f2e7b-dffb-4a05-8fa5-2436a7df2289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:26.459111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2e7b-dffb-4a05-8fa5-2436a7df2289 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:26.459430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2e7b-dffb-4a05-8fa5-2436a7df2289 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:26.459706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2e7b-dffb-4a05-8fa5-2436a7df2289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:26.461339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e47f2e7b-dffb-4a05-8fa5-2436a7df2289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:26.549287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2e7b-dffb-4a05-8fa5-2436a7df2289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:26.550899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2e7b-dffb-4a05-8fa5-2436a7df2289 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:26.569670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 723/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:27.375982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f1c6-6df9-4e49-a995-f535e0357d60 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:27.376565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f1c6-6df9-4e49-a995-f535e0357d60 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:27.376565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f1c6-6df9-4e49-a995-f535e0357d60 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:27.377895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:27.383504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a97345-5b5a-4b87-aced-7033eb2ed503 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:27.383921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a97345-5b5a-4b87-aced-7033eb2ed503 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:27.384053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a97345-5b5a-4b87-aced-7033eb2ed503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:27.460382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-37a97345-5b5a-4b87-aced-7033eb2ed503 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:27.461573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-37a97345-5b5a-4b87-aced-7033eb2ed503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:27.503056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:27.560343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:27.712116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99f1c6-6df9-4e49-a995-f535e0357d60 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:27.713548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dd99f1c6-6df9-4e49-a995-f535e0357d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:27.865371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99f1c6-6df9-4e49-a995-f535e0357d60 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:27.920131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:27.979449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e072b-5929-40bb-a7ec-351d9b69fce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:27.979999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e072b-5929-40bb-a7ec-351d9b69fce6 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:27.980283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e072b-5929-40bb-a7ec-351d9b69fce6 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:27.980560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e072b-5929-40bb-a7ec-351d9b69fce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:27.982263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-934e072b-5929-40bb-a7ec-351d9b69fce6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:28.076897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e072b-5929-40bb-a7ec-351d9b69fce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:28.078535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e072b-5929-40bb-a7ec-351d9b69fce6 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:28.097067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 713/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:28.902255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b21c-1fab-4051-8a2d-9f231a4cfc76 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:28.902773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b21c-1fab-4051-8a2d-9f231a4cfc76 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:28.902773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b21c-1fab-4051-8a2d-9f231a4cfc76 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:28.904128 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:28.909221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3381a-a4b5-4e6c-8151-388ec1264c52 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:28.909612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3381a-a4b5-4e6c-8151-388ec1264c52 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:28.909778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3381a-a4b5-4e6c-8151-388ec1264c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:28.992084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-64e3381a-a4b5-4e6c-8151-388ec1264c52 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:28.993320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-64e3381a-a4b5-4e6c-8151-388ec1264c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:28.995412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:29.096016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:29.250926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8b21c-1fab-4051-8a2d-9f231a4cfc76 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:29.252380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-42c8b21c-1fab-4051-8a2d-9f231a4cfc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:29.397822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8b21c-1fab-4051-8a2d-9f231a4cfc76 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:29.425653 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:29.513137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4026f-9a7f-43a5-87d6-deea6ee9020e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:29.513690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4026f-9a7f-43a5-87d6-deea6ee9020e service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:29.513968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4026f-9a7f-43a5-87d6-deea6ee9020e service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:29.514238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4026f-9a7f-43a5-87d6-deea6ee9020e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:29.515869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3bd4026f-9a7f-43a5-87d6-deea6ee9020e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:29.603843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4026f-9a7f-43a5-87d6-deea6ee9020e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:29.605452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4026f-9a7f-43a5-87d6-deea6ee9020e service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:29.623279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 726/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:31.522256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684076a-6666-4a14-9814-ccdbbfcd5dfb None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:31.522835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684076a-6666-4a14-9814-ccdbbfcd5dfb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:31.522835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684076a-6666-4a14-9814-ccdbbfcd5dfb None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:31.524303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:31.529752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26f0a-ab08-46a0-a097-433b4c53b81a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:31.530158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26f0a-ab08-46a0-a097-433b4c53b81a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:31.530303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26f0a-ab08-46a0-a097-433b4c53b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:31.572537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:31.597560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-09f26f0a-ab08-46a0-a097-433b4c53b81a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:31.598807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-09f26f0a-ab08-46a0-a097-433b4c53b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:31.692706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:31.730981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684076a-6666-4a14-9814-ccdbbfcd5dfb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:31.732569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6684076a-6666-4a14-9814-ccdbbfcd5dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:31.838182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684076a-6666-4a14-9814-ccdbbfcd5dfb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:31.871454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:31.913328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321da03-f927-431c-af1a-7068d1b0aa31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:31.913944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321da03-f927-431c-af1a-7068d1b0aa31 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:31.914226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321da03-f927-431c-af1a-7068d1b0aa31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:31.914509 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321da03-f927-431c-af1a-7068d1b0aa31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:31.916167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e321da03-f927-431c-af1a-7068d1b0aa31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:32.023523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321da03-f927-431c-af1a-7068d1b0aa31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:32.024970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321da03-f927-431c-af1a-7068d1b0aa31 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:32.043512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 716/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:34.201531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5366bd-be77-436d-9af0-d12fb6071a9a None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:34.202113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5366bd-be77-436d-9af0-d12fb6071a9a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:34.202113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5366bd-be77-436d-9af0-d12fb6071a9a None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:34.203464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:34.208959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180baa2-92f6-40a1-8fe8-5fce2a4c667f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:34.209417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180baa2-92f6-40a1-8fe8-5fce2a4c667f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:34.209532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180baa2-92f6-40a1-8fe8-5fce2a4c667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:34.275820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4180baa2-92f6-40a1-8fe8-5fce2a4c667f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:34.277033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4180baa2-92f6-40a1-8fe8-5fce2a4c667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:34.290282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:34.374529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:34.412647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5366bd-be77-436d-9af0-d12fb6071a9a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:34.414165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ab5366bd-be77-436d-9af0-d12fb6071a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:34.517895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5366bd-be77-436d-9af0-d12fb6071a9a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:34.530176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:34.591538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b24f2-d2ae-4533-a6d4-a7a8532eeaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:34.592156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b24f2-d2ae-4533-a6d4-a7a8532eeaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:34.592437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b24f2-d2ae-4533-a6d4-a7a8532eeaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:34.592709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b24f2-d2ae-4533-a6d4-a7a8532eeaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:34.594331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-800b24f2-d2ae-4533-a6d4-a7a8532eeaaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:34.702981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b24f2-d2ae-4533-a6d4-a7a8532eeaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:34.704462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b24f2-d2ae-4533-a6d4-a7a8532eeaaa service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:34.722219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 729/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:11:37.028787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9415b9-945e-43c4-a0e9-7c12633bf567 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:37.029362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9415b9-945e-43c4-a0e9-7c12633bf567 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:37.029362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9415b9-945e-43c4-a0e9-7c12633bf567 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:37.030713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:11:37.036301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342c23-ab6f-4774-87ba-8931de03e2d7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:37.036753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342c23-ab6f-4774-87ba-8931de03e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:37.036865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46342c23-ab6f-4774-87ba-8931de03e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:37.084619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:37.104002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-46342c23-ab6f-4774-87ba-8931de03e2d7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:37.105223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-46342c23-ab6f-4774-87ba-8931de03e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:37.200722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:11:37.240593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9415b9-945e-43c4-a0e9-7c12633bf567 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:37.242153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0c9415b9-945e-43c4-a0e9-7c12633bf567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:37.344924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9415b9-945e-43c4-a0e9-7c12633bf567 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:37.388062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:37.422641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981b656-4af6-4508-a5fd-ec036966d3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:37.423255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b656-4af6-4508-a5fd-ec036966d3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:37.423558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b656-4af6-4508-a5fd-ec036966d3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:37.423832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b656-4af6-4508-a5fd-ec036966d3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:37.425439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7981b656-4af6-4508-a5fd-ec036966d3a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:37.533940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b656-4af6-4508-a5fd-ec036966d3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:37.536021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b656-4af6-4508-a5fd-ec036966d3a7 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:37.553598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 719/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:39.686117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f27d4-f085-46da-a748-852af711e84e None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:39.686708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f27d4-f085-46da-a748-852af711e84e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:39.686708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f27d4-f085-46da-a748-852af711e84e None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:39.688105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:39.693703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4028ee6-af02-4aae-b893-5e7e5bb5ab0d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:39.694115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4028ee6-af02-4aae-b893-5e7e5bb5ab0d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:39.694250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4028ee6-af02-4aae-b893-5e7e5bb5ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:39.761218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d4028ee6-af02-4aae-b893-5e7e5bb5ab0d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:39.762424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d4028ee6-af02-4aae-b893-5e7e5bb5ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:39.782904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:39.859501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:39.899134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f27d4-f085-46da-a748-852af711e84e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:39.900718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e40f27d4-f085-46da-a748-852af711e84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:40.003959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f27d4-f085-46da-a748-852af711e84e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:40.023695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:40.077259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc6b6f-38f9-4b3c-ba36-247adc88e456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:40.077879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6b6f-38f9-4b3c-ba36-247adc88e456 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:40.078163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6b6f-38f9-4b3c-ba36-247adc88e456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:40.078439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6b6f-38f9-4b3c-ba36-247adc88e456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:40.080095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2fbc6b6f-38f9-4b3c-ba36-247adc88e456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:40.187726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc6b6f-38f9-4b3c-ba36-247adc88e456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:40.189178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc6b6f-38f9-4b3c-ba36-247adc88e456 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:40.207703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 732/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:42.339743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afa012-d856-42f0-954d-564ce8d2005c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:42.340316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afa012-d856-42f0-954d-564ce8d2005c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:42.340316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afa012-d856-42f0-954d-564ce8d2005c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:42.341701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:42.347177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d996-e76f-4a49-843a-e14181c19113 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:42.347589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d996-e76f-4a49-843a-e14181c19113 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:42.348409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d996-e76f-4a49-843a-e14181c19113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:42.413080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:42.415936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bec6d996-e76f-4a49-843a-e14181c19113 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:42.417874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bec6d996-e76f-4a49-843a-e14181c19113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:42.514493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:42.553608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afa012-d856-42f0-954d-564ce8d2005c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:42.555132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9afa012-d856-42f0-954d-564ce8d2005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:42.658802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afa012-d856-42f0-954d-564ce8d2005c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:42.707114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:42.732036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37a768-6c3c-4a46-acc5-7c3b17dabbf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:42.732655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a768-6c3c-4a46-acc5-7c3b17dabbf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:42.732933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a768-6c3c-4a46-acc5-7c3b17dabbf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:42.733206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a768-6c3c-4a46-acc5-7c3b17dabbf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:42.734811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3a37a768-6c3c-4a46-acc5-7c3b17dabbf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:42.844790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37a768-6c3c-4a46-acc5-7c3b17dabbf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:42.846229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37a768-6c3c-4a46-acc5-7c3b17dabbf8 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:42.864653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 722/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:44.908678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7e95-bedb-4811-abc4-d8b9b6f72d88 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:44.909209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7e95-bedb-4811-abc4-d8b9b6f72d88 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:44.909209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7e95-bedb-4811-abc4-d8b9b6f72d88 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:44.911042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:44.916799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605aa52-7b54-45da-8154-6f54ee5c6986 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:44.917243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605aa52-7b54-45da-8154-6f54ee5c6986 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:44.917341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605aa52-7b54-45da-8154-6f54ee5c6986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:44.983691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8605aa52-7b54-45da-8154-6f54ee5c6986 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:44.984893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8605aa52-7b54-45da-8154-6f54ee5c6986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:45.013927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:45.086283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:45.123116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7e95-bedb-4811-abc4-d8b9b6f72d88 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:45.124686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2e5d7e95-bedb-4811-abc4-d8b9b6f72d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:45.227634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7e95-bedb-4811-abc4-d8b9b6f72d88 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:45.255493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:45.300658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097de6d-3b05-4588-82d9-5dd7a3e8b11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:45.301397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097de6d-3b05-4588-82d9-5dd7a3e8b11c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:45.301588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097de6d-3b05-4588-82d9-5dd7a3e8b11c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:45.301864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097de6d-3b05-4588-82d9-5dd7a3e8b11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:45.303526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c097de6d-3b05-4588-82d9-5dd7a3e8b11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:45.411635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097de6d-3b05-4588-82d9-5dd7a3e8b11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:45.413082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097de6d-3b05-4588-82d9-5dd7a3e8b11c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:45.430690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 735/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:47.473367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a04f-3aaa-4199-8aab-12b056e6e1ce None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:47.473918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a04f-3aaa-4199-8aab-12b056e6e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:47.473918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3a04f-3aaa-4199-8aab-12b056e6e1ce None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:47.475405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:47.480420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eadb4a-a64b-4591-8096-bccf3b683919 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:47.480869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eadb4a-a64b-4591-8096-bccf3b683919 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:47.481011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eadb4a-a64b-4591-8096-bccf3b683919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:47.547188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-59eadb4a-a64b-4591-8096-bccf3b683919 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:47.548444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-59eadb4a-a64b-4591-8096-bccf3b683919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:47.559404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:47.649502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:47.686094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3a04f-3aaa-4199-8aab-12b056e6e1ce None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:47.687630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34b3a04f-3aaa-4199-8aab-12b056e6e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:47.791831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3a04f-3aaa-4199-8aab-12b056e6e1ce None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:47.846028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:47.865248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f48cb-9e91-47a6-88d7-a9c6e5c6134f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:47.865861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f48cb-9e91-47a6-88d7-a9c6e5c6134f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:47.866144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f48cb-9e91-47a6-88d7-a9c6e5c6134f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:47.866418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f48cb-9e91-47a6-88d7-a9c6e5c6134f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:47.868055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-483f48cb-9e91-47a6-88d7-a9c6e5c6134f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:47.975750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f48cb-9e91-47a6-88d7-a9c6e5c6134f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:47.977190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f48cb-9e91-47a6-88d7-a9c6e5c6134f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:47.995171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 725/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:50.057613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567112e-84dc-46f1-9ea2-43846ccabe70 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:50.058173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567112e-84dc-46f1-9ea2-43846ccabe70 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:50.058173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567112e-84dc-46f1-9ea2-43846ccabe70 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:50.059553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:50.064706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942abd9-3fa8-4a22-b481-b35b78d7889a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:50.065117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942abd9-3fa8-4a22-b481-b35b78d7889a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:50.065265 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942abd9-3fa8-4a22-b481-b35b78d7889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:50.132124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a942abd9-3fa8-4a22-b481-b35b78d7889a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:50.133327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a942abd9-3fa8-4a22-b481-b35b78d7889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:50.171155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:50.229089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:50.265891 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567112e-84dc-46f1-9ea2-43846ccabe70 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:50.267457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3567112e-84dc-46f1-9ea2-43846ccabe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:50.370284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567112e-84dc-46f1-9ea2-43846ccabe70 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:50.407926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:50.444102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa788fcc-cd0b-4015-8723-5a781d1ea14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:50.444720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788fcc-cd0b-4015-8723-5a781d1ea14f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:50.445000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788fcc-cd0b-4015-8723-5a781d1ea14f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:50.445273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788fcc-cd0b-4015-8723-5a781d1ea14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:50.446888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-aa788fcc-cd0b-4015-8723-5a781d1ea14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:50.554931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa788fcc-cd0b-4015-8723-5a781d1ea14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:50.556409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa788fcc-cd0b-4015-8723-5a781d1ea14f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:50.574711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 738/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:52.713165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e1349-ef96-4bdb-9535-8f8ee8330434 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:52.713676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e1349-ef96-4bdb-9535-8f8ee8330434 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:52.713791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e1349-ef96-4bdb-9535-8f8ee8330434 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:52.715087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:52.720348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3a8a1-626a-4557-af45-9305a48d1fe8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:52.720787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3a8a1-626a-4557-af45-9305a48d1fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:52.720943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3a8a1-626a-4557-af45-9305a48d1fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:52.788632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a9a3a8a1-626a-4557-af45-9305a48d1fe8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:52.789856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a9a3a8a1-626a-4557-af45-9305a48d1fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:52.807877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:52.892310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:52.935618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e1349-ef96-4bdb-9535-8f8ee8330434 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:52.937148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-235e1349-ef96-4bdb-9535-8f8ee8330434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:53.044825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e1349-ef96-4bdb-9535-8f8ee8330434 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:53.117021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:53.124581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ae40-f520-42d1-a2fb-1eb8e6679ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:53.125231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ae40-f520-42d1-a2fb-1eb8e6679ebc service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:53.125515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ae40-f520-42d1-a2fb-1eb8e6679ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:53.125788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ae40-f520-42d1-a2fb-1eb8e6679ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:53.127470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-01f4ae40-f520-42d1-a2fb-1eb8e6679ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:53.236557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ae40-f520-42d1-a2fb-1eb8e6679ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:53.237926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ae40-f520-42d1-a2fb-1eb8e6679ebc service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:53.256890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 728/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:11:55.278005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afe54-10bb-4ade-ba4a-f75cc5510657 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:55.278579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afe54-10bb-4ade-ba4a-f75cc5510657 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:55.278579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afe54-10bb-4ade-ba4a-f75cc5510657 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:55.279970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:11:55.285281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960447-3dcc-4a76-ad51-48809cb00fc0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:55.285714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960447-3dcc-4a76-ad51-48809cb00fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:55.285869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960447-3dcc-4a76-ad51-48809cb00fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:55.351302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-00960447-3dcc-4a76-ad51-48809cb00fc0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:11:55.352507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-00960447-3dcc-4a76-ad51-48809cb00fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:55.400827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:55.449451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:11:55.485859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01afe54-10bb-4ade-ba4a-f75cc5510657 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:11:55.487418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d01afe54-10bb-4ade-ba4a-f75cc5510657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:55.592063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01afe54-10bb-4ade-ba4a-f75cc5510657 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:11:55.639830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:11:55.665850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a63a1d-1efb-411b-bd20-774d8bb92f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:11:55.666466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63a1d-1efb-411b-bd20-774d8bb92f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:11:55.666750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63a1d-1efb-411b-bd20-774d8bb92f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:11:55.667029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63a1d-1efb-411b-bd20-774d8bb92f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:11:55.668681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a1a63a1d-1efb-411b-bd20-774d8bb92f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:11:55.778884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a63a1d-1efb-411b-bd20-774d8bb92f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:11:55.780376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a63a1d-1efb-411b-bd20-774d8bb92f09 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:11:55.798413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 741/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:12:05.447657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=22 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:05.796085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=66 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:15.447096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a947-b53c-4d34-9b0c-e16efac571ff None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:15.447730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a947-b53c-4d34-9b0c-e16efac571ff None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:15.447730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a947-b53c-4d34-9b0c-e16efac571ff None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:15.448983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 730/1471] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:15.454180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5041c0-ec07-4773-a30a-6d76f9c269ff None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:15.454599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5041c0-ec07-4773-a30a-6d76f9c269ff None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:15.454734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5041c0-ec07-4773-a30a-6d76f9c269ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:15.524118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7e5041c0-ec07-4773-a30a-6d76f9c269ff None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:15.525379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7e5041c0-ec07-4773-a30a-6d76f9c269ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:15.620577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 742/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:12:15.709182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfb42-2bb9-4d4a-b3d4-f4bbb20d3979 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:15.709468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfb42-2bb9-4d4a-b3d4-f4bbb20d3979 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:15.709743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfb42-2bb9-4d4a-b3d4-f4bbb20d3979 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:15.711286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 731/1473] 10.222.0.48 () {54 vars in 966 bytes} [Wed Jul 27 04:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:15.716050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee211601-fc52-4fe8-9678-0ce1663226ec None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:15.716347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee211601-fc52-4fe8-9678-0ce1663226ec None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:15.716628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee211601-fc52-4fe8-9678-0ce1663226ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:15.793473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ee211601-fc52-4fe8-9678-0ce1663226ec None None] MFA Rules not processed for user `c2d3a3a7c1f545e593e7956ec79f25ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:15.794680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ee211601-fc52-4fe8-9678-0ce1663226ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:15.814992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:15.871039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 743/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Wed Jul 27 04:12:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:12:15.878547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcfb42-2bb9-4d4a-b3d4-f4bbb20d3979 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:12:15.880066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9cfcfb42-2bb9-4d4a-b3d4-f4bbb20d3979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:15.982993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcfb42-2bb9-4d4a-b3d4-f4bbb20d3979 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:12:16.056371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1885b-03d7-4adc-83bb-55002fcedef3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:12:16.056980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1885b-03d7-4adc-83bb-55002fcedef3 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:16.057261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1885b-03d7-4adc-83bb-55002fcedef3 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:16.057535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1885b-03d7-4adc-83bb-55002fcedef3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:16.059144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-52f1885b-03d7-4adc-83bb-55002fcedef3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:16.113979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:16.170556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1885b-03d7-4adc-83bb-55002fcedef3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:12:16.172019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1885b-03d7-4adc-83bb-55002fcedef3 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:12:16.190150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 732/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:12:18.302648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fd7d-8dfb-479f-9d0e-f9ff485fb219 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:18.303237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fd7d-8dfb-479f-9d0e-f9ff485fb219 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:18.303237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fd7d-8dfb-479f-9d0e-f9ff485fb219 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:18.304572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 744/1476] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:18.309635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5dc1-7280-4e57-a38c-438331f7670b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:18.310041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5dc1-7280-4e57-a38c-438331f7670b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:18.310183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5dc1-7280-4e57-a38c-438331f7670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:18.376903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-814a5dc1-7280-4e57-a38c-438331f7670b None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:18.378152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-814a5dc1-7280-4e57-a38c-438331f7670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:18.474415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 733/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:12:18.498934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31fd7d-8dfb-479f-9d0e-f9ff485fb219 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:12:18.500515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8d31fd7d-8dfb-479f-9d0e-f9ff485fb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:18.624947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31fd7d-8dfb-479f-9d0e-f9ff485fb219 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:12:18.672757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:18.717944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe1126-1e64-45f6-b930-041e74e566cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:12:18.718585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1126-1e64-45f6-b930-041e74e566cf admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:18.718865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1126-1e64-45f6-b930-041e74e566cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:18.719136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1126-1e64-45f6-b930-041e74e566cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:18.719867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe1126-1e64-45f6-b930-041e74e566cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:12:18.721657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-befe1126-1e64-45f6-b930-041e74e566cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:12:18.721657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:12:18.721657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:12:18.723503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe1126-1e64-45f6-b930-041e74e566cf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:12:18.742403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 745/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 04:12:18 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:12:20.756139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0f8ae-3b03-4615-a768-f5c31cb8870a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:20.756590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0f8ae-3b03-4615-a768-f5c31cb8870a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:20.756700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0f8ae-3b03-4615-a768-f5c31cb8870a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:20.758055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 734/1479] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:20.763059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7748e-9bb9-4714-a3cf-62636a868b8f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:20.763492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7748e-9bb9-4714-a3cf-62636a868b8f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:20.763648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7748e-9bb9-4714-a3cf-62636a868b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:20.828767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7ba7748e-9bb9-4714-a3cf-62636a868b8f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:20.829964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7ba7748e-9bb9-4714-a3cf-62636a868b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:20.926473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 746/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:12:20.969504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0f8ae-3b03-4615-a768-f5c31cb8870a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:12:20.971243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-63f0f8ae-3b03-4615-a768-f5c31cb8870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:20.981292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:21.117292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0f8ae-3b03-4615-a768-f5c31cb8870a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:12:21.199494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:21.231515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbdc5a-36e7-4079-8c18-26fe5167c8ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:12:21.232146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbdc5a-36e7-4079-8c18-26fe5167c8ef service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:21.232429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbdc5a-36e7-4079-8c18-26fe5167c8ef service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:21.232704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbdc5a-36e7-4079-8c18-26fe5167c8ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:21.234390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-82bbdc5a-36e7-4079-8c18-26fe5167c8ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:21.326267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbdc5a-36e7-4079-8c18-26fe5167c8ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:12:21.327881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbdc5a-36e7-4079-8c18-26fe5167c8ef service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:12:21.346062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 735/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:12:23.516784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabd8b-064d-4ee2-921c-8d79fec862d4 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:23.517338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabd8b-064d-4ee2-921c-8d79fec862d4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:23.517338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabd8b-064d-4ee2-921c-8d79fec862d4 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:23.519275 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 747/1482] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:23.524974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77f3e3-574e-4c57-8120-9d81bafa0389 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:23.525405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77f3e3-574e-4c57-8120-9d81bafa0389 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:23.525520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77f3e3-574e-4c57-8120-9d81bafa0389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:23.591338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5b77f3e3-574e-4c57-8120-9d81bafa0389 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:23.592544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5b77f3e3-574e-4c57-8120-9d81bafa0389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:23.639289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:23.688982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 736/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:12:23.725905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aabd8b-064d-4ee2-921c-8d79fec862d4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:12:23.727479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d2aabd8b-064d-4ee2-921c-8d79fec862d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:23.752579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:23.834201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aabd8b-064d-4ee2-921c-8d79fec862d4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:12:23.906446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052700-14a4-4aa1-8fa2-08c6f61cd36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:12:23.907058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052700-14a4-4aa1-8fa2-08c6f61cd36c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:23.907363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052700-14a4-4aa1-8fa2-08c6f61cd36c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:23.907638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052700-14a4-4aa1-8fa2-08c6f61cd36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:23.909298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7f052700-14a4-4aa1-8fa2-08c6f61cd36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:23.982267 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:24.017903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052700-14a4-4aa1-8fa2-08c6f61cd36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:12:24.019412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052700-14a4-4aa1-8fa2-08c6f61cd36c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:12:24.037120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 748/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:12:26.084706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240019d9-d39a-4130-a37d-c7aaef56d75e None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:26.085305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240019d9-d39a-4130-a37d-c7aaef56d75e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:26.085305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240019d9-d39a-4130-a37d-c7aaef56d75e None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:26.086630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 737/1485] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:26.091814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0fdab-2549-42e8-8252-0f7dd3b80066 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:26.092237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0fdab-2549-42e8-8252-0f7dd3b80066 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:26.092358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0fdab-2549-42e8-8252-0f7dd3b80066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:26.158882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-86d0fdab-2549-42e8-8252-0f7dd3b80066 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:26.160630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-86d0fdab-2549-42e8-8252-0f7dd3b80066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:26.256969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 749/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:12:26.295209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240019d9-d39a-4130-a37d-c7aaef56d75e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:12:26.296811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-240019d9-d39a-4130-a37d-c7aaef56d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:26.400499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240019d9-d39a-4130-a37d-c7aaef56d75e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:12:26.470591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:26.473380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4687c8e-4d15-46f8-b3e3-09c795891b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:12:26.474194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687c8e-4d15-46f8-b3e3-09c795891b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:26.474534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687c8e-4d15-46f8-b3e3-09c795891b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:26.475008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687c8e-4d15-46f8-b3e3-09c795891b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:26.476906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b4687c8e-4d15-46f8-b3e3-09c795891b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:26.585879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4687c8e-4d15-46f8-b3e3-09c795891b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:12:26.587355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4687c8e-4d15-46f8-b3e3-09c795891b15 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:12:26.605578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 738/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:12:28.727833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a901-b62c-4547-992b-2989e127a248 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:28.728392 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a901-b62c-4547-992b-2989e127a248 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:28.728530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a901-b62c-4547-992b-2989e127a248 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:28.729802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 750/1488] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:28.734992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d34b07-8ed0-4bb6-9d30-890123329374 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:28.735444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d34b07-8ed0-4bb6-9d30-890123329374 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:28.735575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d34b07-8ed0-4bb6-9d30-890123329374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:28.803704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a9d34b07-8ed0-4bb6-9d30-890123329374 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:28.804932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a9d34b07-8ed0-4bb6-9d30-890123329374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:28.858023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:28.902843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 739/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:12:28.943662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a901-b62c-4547-992b-2989e127a248 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:12:28.945178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-eed0a901-b62c-4547-992b-2989e127a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:28.981508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:29.049522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a901-b62c-4547-992b-2989e127a248 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:12:29.122030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1b62-3d2a-4391-8dad-6ace370600e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:12:29.122638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1b62-3d2a-4391-8dad-6ace370600e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:29.122915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1b62-3d2a-4391-8dad-6ace370600e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:29.123184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1b62-3d2a-4391-8dad-6ace370600e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:29.124840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7b8f1b62-3d2a-4391-8dad-6ace370600e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:29.333655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:29.363638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1b62-3d2a-4391-8dad-6ace370600e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:12:29.365087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1b62-3d2a-4391-8dad-6ace370600e0 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:12:29.383501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 751/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:12:31.676840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b6d3-74a5-49b8-a171-9bbbd4bbd7cd None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:31.677413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b6d3-74a5-49b8-a171-9bbbd4bbd7cd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:31.677413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b6d3-74a5-49b8-a171-9bbbd4bbd7cd None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:31.678807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 740/1491] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 04:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:12:31.684080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745e3a8-331e-4021-96ec-0bbcd2fbc9e8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:31.684485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745e3a8-331e-4021-96ec-0bbcd2fbc9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:31.684630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745e3a8-331e-4021-96ec-0bbcd2fbc9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:31.754141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c745e3a8-331e-4021-96ec-0bbcd2fbc9e8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:12:31.755377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c745e3a8-331e-4021-96ec-0bbcd2fbc9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:31.850776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 752/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 04:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:12:31.889892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b6d3-74a5-49b8-a171-9bbbd4bbd7cd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:12:31.891494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6c50b6d3-74a5-49b8-a171-9bbbd4bbd7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:31.994719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b6d3-74a5-49b8-a171-9bbbd4bbd7cd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:12:32.068827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65994fd9-b7fe-4462-9658-01bd2ac7b3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:12:32.069445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994fd9-b7fe-4462-9658-01bd2ac7b3ac service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:12:32.069725 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994fd9-b7fe-4462-9658-01bd2ac7b3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:12:32.070003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994fd9-b7fe-4462-9658-01bd2ac7b3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:12:32.071639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-65994fd9-b7fe-4462-9658-01bd2ac7b3ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:12:32.080634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:32.181333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65994fd9-b7fe-4462-9658-01bd2ac7b3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:12:32.182779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65994fd9-b7fe-4462-9658-01bd2ac7b3ac service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:12:32.200423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 741/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:12:41.848994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=82 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:12:42.198106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=50 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:26.544839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:26.545452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:26.545452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:26.620116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:14:26.621320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:26.717297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 753/1494] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:14:26.725595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039051ae-6863-412c-a237-2914f0b13176 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:26.726111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039051ae-6863-412c-a237-2914f0b13176 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:26.726220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039051ae-6863-412c-a237-2914f0b13176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:26.803078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-039051ae-6863-412c-a237-2914f0b13176 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:14:26.804333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-039051ae-6863-412c-a237-2914f0b13176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:26.901799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 742/1495] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:14:26.906416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:26.908371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:26.919830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c68eb-86f6-4598-a0c3-3f270fe81b8c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:26.981379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:27.016787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:27.017490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:27.017779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:27.018283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:27.018992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:14:27.019700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:27.020513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:27.020513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:14:27.020513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:14:27.021676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:27.036194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 754/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:14:27.044532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039051ae-6863-412c-a237-2914f0b13176 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:27.054075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039051ae-6863-412c-a237-2914f0b13176 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:27.117384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:27.151758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:27.152368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:27.152648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:27.152921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:27.153583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:27.155310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:27.155310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: warnings.warn(msg) Jul 27 04:14:27.155310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: Jul 27 04:14:27.156513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:27.213978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 743/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:14:27 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:14:27.218157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:27.220403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:27.252711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf5b41-2410-442e-ab57-7984dadeec35 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:27.345151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:27.345681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:27.345955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:27.346221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:27.346878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:27.347926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:27.347926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:14:27.347926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:14:27.349144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:27.390392 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 755/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:14:27 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:14:27.395190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:27.396699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:27.459048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4ec4-8c1a-4fd0-abdf-f2263c4437e3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:27.541587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:27.552417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:27.553029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:27.553303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:27.553588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:27.554248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:27.555242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:27.555242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: warnings.warn(msg) Jul 27 04:14:27.555242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: Jul 27 04:14:27.556168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:27.569272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 744/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:14:27.573286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:27.574826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:27.586593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73774be4-f7c3-4daf-9a80-7fb8499bd17a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:27.610684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:27.681691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54f24e-123d-44fe-aa2e-f6913bfce4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:27.682329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f24e-123d-44fe-aa2e-f6913bfce4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:27.682607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f24e-123d-44fe-aa2e-f6913bfce4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:27.682875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f24e-123d-44fe-aa2e-f6913bfce4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:27.683589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54f24e-123d-44fe-aa2e-f6913bfce4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:27.684599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-fb54f24e-123d-44fe-aa2e-f6913bfce4d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:27.684599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:14:27.684599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:14:27.685482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54f24e-123d-44fe-aa2e-f6913bfce4d9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:27.698204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 756/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:14:27.702402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:27.704165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:27.737110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a91d-97a0-415c-869f-7f0733104924 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:27.834135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590eed1-57fb-46d8-bf87-755dd99d1bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:27.834828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590eed1-57fb-46d8-bf87-755dd99d1bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:27.835094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590eed1-57fb-46d8-bf87-755dd99d1bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:27.835399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590eed1-57fb-46d8-bf87-755dd99d1bf1 admin admin] PATH_INFO: `/v3/projects/d6bc60bf2ca44569909184e805c809b8/users/027819ba00534fffb3cc6ad495217a6b/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:27.858411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590eed1-57fb-46d8-bf87-755dd99d1bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bc60bf2ca44569909184e805c809b8, user_id=027819ba00534fffb3cc6ad495217a6b, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:27.859473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-5590eed1-57fb-46d8-bf87-755dd99d1bf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:27.859473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: warnings.warn(msg) Jul 27 04:14:27.859473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: Jul 27 04:14:27.862618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590eed1-57fb-46d8-bf87-755dd99d1bf1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:27.888944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 745/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:14:27 2022] PUT /identity/v3/projects/d6bc60bf2ca44569909184e805c809b8/users/027819ba00534fffb3cc6ad495217a6b/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:14:27.901186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc62484-5d4d-4b31-900c-0e5c99b9570d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:27.901474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc62484-5d4d-4b31-900c-0e5c99b9570d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:27.901750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc62484-5d4d-4b31-900c-0e5c99b9570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:27.958603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8cc62484-5d4d-4b31-900c-0e5c99b9570d None None] MFA Rules not processed for user `027819ba00534fffb3cc6ad495217a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:14:27.959851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8cc62484-5d4d-4b31-900c-0e5c99b9570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:28.038330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 757/1502] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:14:28.053157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f75fb3-d2d0-432f-b3ca-8e94cf12912c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:28.053157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f75fb3-d2d0-432f-b3ca-8e94cf12912c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:28.053157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f75fb3-d2d0-432f-b3ca-8e94cf12912c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:28.054143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 746/1503] 10.222.0.48 () {54 vars in 964 bytes} [Wed Jul 27 04:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:14:28.059048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1cf5c-0ea6-4764-a89c-502154eadf64 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:28.059373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1cf5c-0ea6-4764-a89c-502154eadf64 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:28.059651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1cf5c-0ea6-4764-a89c-502154eadf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:28.089888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:28.136388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2bb1cf5c-0ea6-4764-a89c-502154eadf64 None None] MFA Rules not processed for user `046b235e211744b0bfe631e0acf4d6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:14:28.137516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2bb1cf5c-0ea6-4764-a89c-502154eadf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:28.212709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 758/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Jul 27 04:14:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:14:28.221047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f75fb3-d2d0-432f-b3ca-8e94cf12912c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:28.222572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-04f75fb3-d2d0-432f-b3ca-8e94cf12912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:28.272711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:28.327429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f75fb3-d2d0-432f-b3ca-8e94cf12912c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:28.411647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:28.412178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:28.412452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:28.412724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:28.414574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:28.514715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:28.516693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:28.520090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:28.535348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 747/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:14:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:14:28.579511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ef09-82dd-4f4e-adbe-6916d880ae7b None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:28.579932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ef09-82dd-4f4e-adbe-6916d880ae7b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:28.580054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ef09-82dd-4f4e-adbe-6916d880ae7b None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:28.581315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 759/1506] 10.222.0.48 () {52 vars in 830 bytes} [Wed Jul 27 04:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:14:28.584928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:28.586109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:28.684971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb96de0-8d5f-4e7a-86c9-4e8a13b68123 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:28.778222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:28.778860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:28.779140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:28.779450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] PATH_INFO: `/v3/users/027819ba00534fffb3cc6ad495217a6b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:28.792242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027819ba00534fffb3cc6ad495217a6b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:28.793264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:28.793264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: warnings.warn(msg) Jul 27 04:14:28.793264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: Jul 27 04:14:28.794484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:28.804512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:28.857747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027819ba00534fffb3cc6ad495217a6b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:28.866894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027819ba00534fffb3cc6ad495217a6b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:28.880293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027819ba00534fffb3cc6ad495217a6b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:28.880740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027819ba00534fffb3cc6ad495217a6b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:28.881249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027819ba00534fffb3cc6ad495217a6b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:28.905008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 748/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:14:28 2022] DELETE /identity/v3/users/027819ba00534fffb3cc6ad495217a6b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:14:28.910025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:28.910309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:28.910582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:28.966820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:14:28.967981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:29.042931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:29.055881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 760/1508] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:14:29.066330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:29.067629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:29.169483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e74d7-6052-4df9-b786-5b109f515382 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:29.223549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:29.245528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a873d1-e1e6-42e8-ac4e-6a15938f3973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:29.246144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a873d1-e1e6-42e8-ac4e-6a15938f3973 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:29.246427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a873d1-e1e6-42e8-ac4e-6a15938f3973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:29.246695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a873d1-e1e6-42e8-ac4e-6a15938f3973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:29.248324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a9a873d1-e1e6-42e8-ac4e-6a15938f3973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:29.355803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a873d1-e1e6-42e8-ac4e-6a15938f3973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:29.357242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a873d1-e1e6-42e8-ac4e-6a15938f3973 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:29.377386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 749/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:14:29.733327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:14:29.734589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:14:29.749352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce5586-1df4-4bb7-843c-ad4d82e43884 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:14:29.846360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:14:29.846999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:14:29.847300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:14:29.847575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] PATH_INFO: `/v3/projects/d6bc60bf2ca44569909184e805c809b8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:14:29.857255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bc60bf2ca44569909184e805c809b8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:14:29.858272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:14:29.858272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:14:29.858272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:14:29.859499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:14:29.918580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bc60bf2ca44569909184e805c809b8', 'request_id': 'req-a4497cf7-9729-489d-ad8c-6126ac0b6e46'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:29.924867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bc60bf2ca44569909184e805c809b8', 'request_id': 'req-a4497cf7-9729-489d-ad8c-6126ac0b6e46'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:29.933682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bc60bf2ca44569909184e805c809b8', 'request_id': 'req-a4497cf7-9729-489d-ad8c-6126ac0b6e46'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:29.963175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] The token cache is being invalidate because project d6bc60bf2ca44569909184e805c809b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:14:29.963491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:29.963922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4497cf7-9729-489d-ad8c-6126ac0b6e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:14:29.965325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 761/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:14:29 2022] DELETE /identity/v3/projects/d6bc60bf2ca44569909184e805c809b8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:14:39.374129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=62 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:14:39.961225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:16:09.455737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c9e5-bcac-4420-8300-6f2c9f38ea89 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:09.456387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c9e5-bcac-4420-8300-6f2c9f38ea89 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:09.456387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c9e5-bcac-4420-8300-6f2c9f38ea89 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:09.457734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:09.462591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e759b5-657a-475e-a2af-860a0a79bab8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:09.463012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e759b5-657a-475e-a2af-860a0a79bab8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:09.463138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e759b5-657a-475e-a2af-860a0a79bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:09.543118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-33e759b5-657a-475e-a2af-860a0a79bab8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:09.544344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-33e759b5-657a-475e-a2af-860a0a79bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:09.645457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:09.799809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c9e5-bcac-4420-8300-6f2c9f38ea89 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:09.802008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d162c9e5-bcac-4420-8300-6f2c9f38ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:09.922845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c9e5-bcac-4420-8300-6f2c9f38ea89 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:09.928990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a487a-1800-4826-8794-4731040fd46b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:09.929605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a487a-1800-4826-8794-4731040fd46b service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:09.929893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a487a-1800-4826-8794-4731040fd46b service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:09.930176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a487a-1800-4826-8794-4731040fd46b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:09.938110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a487a-1800-4826-8794-4731040fd46b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:09.939880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a487a-1800-4826-8794-4731040fd46b service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:09.949129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 751/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:10.786516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15fab9-3a08-4672-8d07-bf375d61f29c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:10.786950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15fab9-3a08-4672-8d07-bf375d61f29c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:10.787061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15fab9-3a08-4672-8d07-bf375d61f29c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:10.788490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:10.793419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4474-da67-4976-a227-f7cd8f9a2a37 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:10.793868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4474-da67-4976-a227-f7cd8f9a2a37 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:10.794097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4474-da67-4976-a227-f7cd8f9a2a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:10.814823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-96fb4474-da67-4976-a227-f7cd8f9a2a37 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:10.816059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-96fb4474-da67-4976-a227-f7cd8f9a2a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:10.823919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:10.974381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15fab9-3a08-4672-8d07-bf375d61f29c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:10.989239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15fab9-3a08-4672-8d07-bf375d61f29c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:10.994899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c676e5-c647-4c61-a2a2-df1d171fff59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:10.995659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c676e5-c647-4c61-a2a2-df1d171fff59 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:10.995895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c676e5-c647-4c61-a2a2-df1d171fff59 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:10.996206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c676e5-c647-4c61-a2a2-df1d171fff59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:11.005155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c676e5-c647-4c61-a2a2-df1d171fff59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:11.006755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c676e5-c647-4c61-a2a2-df1d171fff59 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:11.016146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 764/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:11.522331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1309c-ab0c-43a8-9ce5-d46849df4bc9 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:11.522616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1309c-ab0c-43a8-9ce5-d46849df4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:11.522918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1309c-ab0c-43a8-9ce5-d46849df4bc9 None None] PATH_INFO: `/v3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:11.524273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 753/1517] 10.222.0.49 () {54 vars in 925 bytes} [Wed Jul 27 04:16:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:16:11.530419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb491-1b50-47a2-a211-2eda56a62700 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:11.530712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb491-1b50-47a2-a211-2eda56a62700 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:11.530993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb491-1b50-47a2-a211-2eda56a62700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:11.589493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-768fb491-1b50-47a2-a211-2eda56a62700 None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:11.590702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-768fb491-1b50-47a2-a211-2eda56a62700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:11.607741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:16:11.662193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 765/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Jul 27 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:15.476674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54621-beb0-46b5-915a-04558b039b39 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:15.477231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54621-beb0-46b5-915a-04558b039b39 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:15.477231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54621-beb0-46b5-915a-04558b039b39 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:15.478593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 754/1519] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jul 27 04:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:15.483464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081f01-8742-4c16-9b89-f0a8577b0ff8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:15.483927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081f01-8742-4c16-9b89-f0a8577b0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:15.484035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081f01-8742-4c16-9b89-f0a8577b0ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:15.504412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c1081f01-8742-4c16-9b89-f0a8577b0ff8 None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:15.505607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c1081f01-8742-4c16-9b89-f0a8577b0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:15.514411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 766/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jul 27 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:15.522033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54621-beb0-46b5-915a-04558b039b39 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:15.535283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54621-beb0-46b5-915a-04558b039b39 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:15.540210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a918eb-01da-419f-ad88-0f28dda69765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:15.540810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a918eb-01da-419f-ad88-0f28dda69765 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:15.541194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a918eb-01da-419f-ad88-0f28dda69765 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:15.541579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a918eb-01da-419f-ad88-0f28dda69765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:15.551339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a918eb-01da-419f-ad88-0f28dda69765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:15.552926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a918eb-01da-419f-ad88-0f28dda69765 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:15.562458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 755/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:22.239672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bfc12-0b6c-407f-8cd2-74a5947df426 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:22.240512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bfc12-0b6c-407f-8cd2-74a5947df426 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:22.240512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bfc12-0b6c-407f-8cd2-74a5947df426 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:22.242045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:22.246733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20394fd-41f5-4e28-8485-7a750ecde2a9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:22.247167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20394fd-41f5-4e28-8485-7a750ecde2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:22.247303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20394fd-41f5-4e28-8485-7a750ecde2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:22.266591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f20394fd-41f5-4e28-8485-7a750ecde2a9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:22.268743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f20394fd-41f5-4e28-8485-7a750ecde2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:22.276389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:22.433595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bfc12-0b6c-407f-8cd2-74a5947df426 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:22.449094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bfc12-0b6c-407f-8cd2-74a5947df426 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:22.454382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944c2eb-a287-42c8-97b9-5a3ed4b456b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:22.456115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c2eb-a287-42c8-97b9-5a3ed4b456b0 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:22.456399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c2eb-a287-42c8-97b9-5a3ed4b456b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:22.456675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944c2eb-a287-42c8-97b9-5a3ed4b456b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:22.464617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944c2eb-a287-42c8-97b9-5a3ed4b456b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:22.466194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944c2eb-a287-42c8-97b9-5a3ed4b456b0 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:22.476167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 768/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:23.309700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d134-89f8-445a-a707-c48aed7ae02f None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:23.310276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d134-89f8-445a-a707-c48aed7ae02f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:23.310276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d134-89f8-445a-a707-c48aed7ae02f None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:23.311665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 04:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:23.316998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cda793-366a-4fcc-92f9-74da61c62937 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:23.317432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cda793-366a-4fcc-92f9-74da61c62937 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:23.317541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cda793-366a-4fcc-92f9-74da61c62937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:23.338527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-19cda793-366a-4fcc-92f9-74da61c62937 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:23.339748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-19cda793-366a-4fcc-92f9-74da61c62937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:23.347603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 04:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:23.500231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d134-89f8-445a-a707-c48aed7ae02f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:23.515074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d134-89f8-445a-a707-c48aed7ae02f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:23.521172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5b7d9-5e3e-4350-a5e8-9c9ddada9fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:23.521783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b7d9-5e3e-4350-a5e8-9c9ddada9fc2 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:23.522065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b7d9-5e3e-4350-a5e8-9c9ddada9fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:23.522341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5b7d9-5e3e-4350-a5e8-9c9ddada9fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:23.530439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5b7d9-5e3e-4350-a5e8-9c9ddada9fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:23.532058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5b7d9-5e3e-4350-a5e8-9c9ddada9fc2 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:23.542084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 758/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:27.288195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd958-4381-4b83-bf83-cd956a1f3774 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:27.288765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd958-4381-4b83-bf83-cd956a1f3774 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:27.288765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd958-4381-4b83-bf83-cd956a1f3774 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:27.290125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:27.295134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12c17-329e-406f-86ec-413a7bc0e89f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:27.295573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12c17-329e-406f-86ec-413a7bc0e89f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:27.295710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12c17-329e-406f-86ec-413a7bc0e89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:27.315897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d7e12c17-329e-406f-86ec-413a7bc0e89f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:27.317077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d7e12c17-329e-406f-86ec-413a7bc0e89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:27.324706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:27.396618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd958-4381-4b83-bf83-cd956a1f3774 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:27.398327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b4abd958-4381-4b83-bf83-cd956a1f3774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:27.474987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd958-4381-4b83-bf83-cd956a1f3774 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:27.478525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64524a-fdca-4676-bc94-812168fc908e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:27.479136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64524a-fdca-4676-bc94-812168fc908e service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:27.479442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64524a-fdca-4676-bc94-812168fc908e service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:27.479715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64524a-fdca-4676-bc94-812168fc908e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:27.489254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64524a-fdca-4676-bc94-812168fc908e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:27.490974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64524a-fdca-4676-bc94-812168fc908e service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:27.500189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 771/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:16:29.491614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8cb1-46ea-4e80-93f5-12743459d3b4 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:29.492033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8cb1-46ea-4e80-93f5-12743459d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:29.492149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8cb1-46ea-4e80-93f5-12743459d3b4 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:29.493516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:29.498735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4d4c-6d45-4205-b00a-daf2347b4c6f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:29.499179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4d4c-6d45-4205-b00a-daf2347b4c6f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:29.499354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4d4c-6d45-4205-b00a-daf2347b4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:29.519019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f53a4d4c-6d45-4205-b00a-daf2347b4c6f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:29.520263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f53a4d4c-6d45-4205-b00a-daf2347b4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:29.528262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:29.562965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f8cb1-46ea-4e80-93f5-12743459d3b4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:29.573968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f8cb1-46ea-4e80-93f5-12743459d3b4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:29.577389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb74e7-ad34-4000-a38d-9ae5bb79446f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:29.577986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb74e7-ad34-4000-a38d-9ae5bb79446f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:29.578264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb74e7-ad34-4000-a38d-9ae5bb79446f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:29.578533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb74e7-ad34-4000-a38d-9ae5bb79446f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:29.588130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb74e7-ad34-4000-a38d-9ae5bb79446f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:29.589542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb74e7-ad34-4000-a38d-9ae5bb79446f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:29.599701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 761/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:33.098101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2eee2-47d4-4627-ac1e-ef3b76df809c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:33.098640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2eee2-47d4-4627-ac1e-ef3b76df809c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:33.098640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2eee2-47d4-4627-ac1e-ef3b76df809c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:33.100048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:33.105261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d56344-6a8d-4adf-9cfe-9f817a137d96 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:33.105740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d56344-6a8d-4adf-9cfe-9f817a137d96 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:33.105844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d56344-6a8d-4adf-9cfe-9f817a137d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:33.125821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-09d56344-6a8d-4adf-9cfe-9f817a137d96 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:33.127026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-09d56344-6a8d-4adf-9cfe-9f817a137d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:33.134815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:33.443282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2eee2-47d4-4627-ac1e-ef3b76df809c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:33.444966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-52b2eee2-47d4-4627-ac1e-ef3b76df809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:33.509407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:16:33.523761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2eee2-47d4-4627-ac1e-ef3b76df809c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:33.527339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85d1c4-db79-4ed4-80de-5cf8d99bd6d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:33.527956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d1c4-db79-4ed4-80de-5cf8d99bd6d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:33.528240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d1c4-db79-4ed4-80de-5cf8d99bd6d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:33.528516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d1c4-db79-4ed4-80de-5cf8d99bd6d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:33.537601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85d1c4-db79-4ed4-80de-5cf8d99bd6d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:33.539033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85d1c4-db79-4ed4-80de-5cf8d99bd6d1 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:33.548946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 774/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:35.581618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4b37-9c8f-493c-987a-f6e39ace1b1c None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:35.582173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4b37-9c8f-493c-987a-f6e39ace1b1c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:35.582173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4b37-9c8f-493c-987a-f6e39ace1b1c None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:35.583602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 04:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:16:35.588751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b55f3-6f06-409e-a3d3-9d0874c0864c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:35.589135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b55f3-6f06-409e-a3d3-9d0874c0864c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:35.589298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b55f3-6f06-409e-a3d3-9d0874c0864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:35.608799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-809b55f3-6f06-409e-a3d3-9d0874c0864c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:16:35.609988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-809b55f3-6f06-409e-a3d3-9d0874c0864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:35.618148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 04:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:16:35.922377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac4b37-9c8f-493c-987a-f6e39ace1b1c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:16:35.924180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c0ac4b37-9c8f-493c-987a-f6e39ace1b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:16:35.937032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac4b37-9c8f-493c-987a-f6e39ace1b1c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:16:35.941089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e0c65-d7d2-4edc-9176-afdbda1bb4ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:16:35.941698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0c65-d7d2-4edc-9176-afdbda1bb4ad service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:16:35.941988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0c65-d7d2-4edc-9176-afdbda1bb4ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:16:35.942266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e0c65-d7d2-4edc-9176-afdbda1bb4ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:16:35.951159 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e0c65-d7d2-4edc-9176-afdbda1bb4ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:16:35.952616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e0c65-d7d2-4edc-9176-afdbda1bb4ad service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:16:35.962508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 764/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:16:45.604101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=11 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:16:45.958497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:07.343738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf2d27-7797-4953-92d0-1d0ee766612f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.345004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf2d27-7797-4953-92d0-1d0ee766612f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.345532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf2d27-7797-4953-92d0-1d0ee766612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.367719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-05cf2d27-7797-4953-92d0-1d0ee766612f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.369451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-05cf2d27-7797-4953-92d0-1d0ee766612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.381403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 776/1540] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.391098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25573d0-dc2c-4272-9ffb-c7151aad8a88 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.392121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25573d0-dc2c-4272-9ffb-c7151aad8a88 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.392641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25573d0-dc2c-4272-9ffb-c7151aad8a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.420945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b25573d0-dc2c-4272-9ffb-c7151aad8a88 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.422533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b25573d0-dc2c-4272-9ffb-c7151aad8a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.434112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 765/1541] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.440713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf2d27-7797-4953-92d0-1d0ee766612f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:07.456020 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf2d27-7797-4953-92d0-1d0ee766612f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:07.463467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e475e-0236-4fd2-9b79-3f0c0e87e248 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.464067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e475e-0236-4fd2-9b79-3f0c0e87e248 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.464584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e475e-0236-4fd2-9b79-3f0c0e87e248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.468229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:07.470096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.471413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.472760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.473719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:07.479438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:07.483393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:07.507915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bb7e475e-0236-4fd2-9b79-3f0c0e87e248 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.510353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bb7e475e-0236-4fd2-9b79-3f0c0e87e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.514514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 777/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:07.525008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:07.536932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 766/1543] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.538558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878dea-0815-4e70-9ba8-7b62fc5f3ef9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.539283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878dea-0815-4e70-9ba8-7b62fc5f3ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.542064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878dea-0815-4e70-9ba8-7b62fc5f3ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.545194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5f94c-19ca-4690-9bb8-a67358fe7fc6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:07.554048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d493f7b-db13-4611-9d67-5a994499616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:07.554982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d493f7b-db13-4611-9d67-5a994499616c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.557197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d493f7b-db13-4611-9d67-5a994499616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.557719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d493f7b-db13-4611-9d67-5a994499616c admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.558623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d493f7b-db13-4611-9d67-5a994499616c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:07.562436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-3d493f7b-db13-4611-9d67-5a994499616c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:18:07.562436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:18:07.562436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:18:07.564195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d493f7b-db13-4611-9d67-5a994499616c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:07.584377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4e878dea-0815-4e70-9ba8-7b62fc5f3ef9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.585920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4e878dea-0815-4e70-9ba8-7b62fc5f3ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.605679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 767/1544] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.607434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2830961-55a8-4f69-b72f-12a7344baa0e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.607694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2830961-55a8-4f69-b72f-12a7344baa0e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.607925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2830961-55a8-4f69-b72f-12a7344baa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.633457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e2830961-55a8-4f69-b72f-12a7344baa0e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.634878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e2830961-55a8-4f69-b72f-12a7344baa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.648986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 778/1545] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:18:07.656740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ab924-bf0d-45e2-9229-839d43893953 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.657019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ab924-bf0d-45e2-9229-839d43893953 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.657298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ab924-bf0d-45e2-9229-839d43893953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.658766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 768/1546] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.660535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad98c-c254-420c-a768-f6d5f091e633 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.660830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad98c-c254-420c-a768-f6d5f091e633 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.661102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad98c-c254-420c-a768-f6d5f091e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.687398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fd9ad98c-c254-420c-a768-f6d5f091e633 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.688612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fd9ad98c-c254-420c-a768-f6d5f091e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.689562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-555ab924-bf0d-45e2-9229-839d43893953 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.690917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-555ab924-bf0d-45e2-9229-839d43893953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.766172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 779/1547] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.767253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 769/1548] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.767539 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c243582-fd0c-4d74-81fb-5f62692dc602 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.767832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c243582-fd0c-4d74-81fb-5f62692dc602 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.768255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c243582-fd0c-4d74-81fb-5f62692dc602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.769103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad98c-c254-420c-a768-f6d5f091e633 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:07.779554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad98c-c254-420c-a768-f6d5f091e633 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:07.784448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944d282-3b08-4ba7-871c-d051f5237a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:07.785064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944d282-3b08-4ba7-871c-d051f5237a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.785343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944d282-3b08-4ba7-871c-d051f5237a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.785617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944d282-3b08-4ba7-871c-d051f5237a4b admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.786275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944d282-3b08-4ba7-871c-d051f5237a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:07.787309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-e944d282-3b08-4ba7-871c-d051f5237a4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:18:07.787309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: warnings.warn(msg) Jul 27 04:18:07.787309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: Jul 27 04:18:07.787595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-4c243582-fd0c-4d74-81fb-5f62692dc602 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.788534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944d282-3b08-4ba7-871c-d051f5237a4b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:07.788789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4c243582-fd0c-4d74-81fb-5f62692dc602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.797563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 780/1549] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.798147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c243582-fd0c-4d74-81fb-5f62692dc602 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:07.808187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c243582-fd0c-4d74-81fb-5f62692dc602 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:07.813405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068fdb-c348-4c62-a936-d9d71195e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:07.813923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 770/1550] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:07.814081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068fdb-c348-4c62-a936-d9d71195e90a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.814315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068fdb-c348-4c62-a936-d9d71195e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.814557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068fdb-c348-4c62-a936-d9d71195e90a admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.815243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068fdb-c348-4c62-a936-d9d71195e90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:07.815394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78197-6597-4b51-9ba2-ad8246df47f5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.815587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068fdb-c348-4c62-a936-d9d71195e90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:07.815700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78197-6597-4b51-9ba2-ad8246df47f5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.815917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78197-6597-4b51-9ba2-ad8246df47f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.817317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068fdb-c348-4c62-a936-d9d71195e90a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:07.831301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 781/1551] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:07.831301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8ef9-0a29-4be5-9b4e-6e61192b1c60 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.831301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8ef9-0a29-4be5-9b4e-6e61192b1c60 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.831689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8ef9-0a29-4be5-9b4e-6e61192b1c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.842197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fab78197-6597-4b51-9ba2-ad8246df47f5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.843488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fab78197-6597-4b51-9ba2-ad8246df47f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.850919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-273e8ef9-0a29-4be5-9b4e-6e61192b1c60 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.851668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 771/1552] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.852134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-273e8ef9-0a29-4be5-9b4e-6e61192b1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.852856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e15e-9fad-40dd-b6a8-b24718ae61f1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.853144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e15e-9fad-40dd-b6a8-b24718ae61f1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.853418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e15e-9fad-40dd-b6a8-b24718ae61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.861611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 782/1553] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.862855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e8ef9-0a29-4be5-9b4e-6e61192b1c60 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:07.873581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e8ef9-0a29-4be5-9b4e-6e61192b1c60 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:07.875566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bde4e15e-9fad-40dd-b6a8-b24718ae61f1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.876741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bde4e15e-9fad-40dd-b6a8-b24718ae61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.878286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e364a01-bd22-4430-8658-f77f4b3ef12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:07.878901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e364a01-bd22-4430-8658-f77f4b3ef12b admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.879197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e364a01-bd22-4430-8658-f77f4b3ef12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.879503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e364a01-bd22-4430-8658-f77f4b3ef12b admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.880193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e364a01-bd22-4430-8658-f77f4b3ef12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:07.880496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e364a01-bd22-4430-8658-f77f4b3ef12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:07.882093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e364a01-bd22-4430-8658-f77f4b3ef12b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:07.884939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 772/1554] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.886193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac240-ebc2-4e1d-bb36-a00c12c0b21b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.886482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac240-ebc2-4e1d-bb36-a00c12c0b21b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.886755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac240-ebc2-4e1d-bb36-a00c12c0b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.904011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 783/1555] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:07.904011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbacdd-6b64-45eb-a12e-0147504034bc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.904011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbacdd-6b64-45eb-a12e-0147504034bc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.904011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbacdd-6b64-45eb-a12e-0147504034bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.910681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-406ac240-ebc2-4e1d-bb36-a00c12c0b21b None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.911930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-406ac240-ebc2-4e1d-bb36-a00c12c0b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.917790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-22fbacdd-6b64-45eb-a12e-0147504034bc None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.919504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-22fbacdd-6b64-45eb-a12e-0147504034bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.920605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 773/1556] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.921221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac240-ebc2-4e1d-bb36-a00c12c0b21b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:07.928781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 784/1557] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.928781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbacdd-6b64-45eb-a12e-0147504034bc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:07.931220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac240-ebc2-4e1d-bb36-a00c12c0b21b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:07.935856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642d12f-1a46-4668-bb66-efd8973392f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:07.936448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642d12f-1a46-4668-bb66-efd8973392f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.936725 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642d12f-1a46-4668-bb66-efd8973392f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.936996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642d12f-1a46-4668-bb66-efd8973392f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.937677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642d12f-1a46-4668-bb66-efd8973392f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:07.939287 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642d12f-1a46-4668-bb66-efd8973392f1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:07.939960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbacdd-6b64-45eb-a12e-0147504034bc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:07.944499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8c972-8225-45b2-9779-df55043fc756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:07.945090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8c972-8225-45b2-9779-df55043fc756 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.945371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8c972-8225-45b2-9779-df55043fc756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.945645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8c972-8225-45b2-9779-df55043fc756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.946304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8c972-8225-45b2-9779-df55043fc756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:07.948237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8c972-8225-45b2-9779-df55043fc756 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:07.949242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 774/1558] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:07.950933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ed9b-5f34-4035-8946-c178a4d6b6d1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.951313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ed9b-5f34-4035-8946-c178a4d6b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.951602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ed9b-5f34-4035-8946-c178a4d6b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.971328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-90f3ed9b-5f34-4035-8946-c178a4d6b6d1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:07.972490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-90f3ed9b-5f34-4035-8946-c178a4d6b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:07.978707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 785/1559] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:07.980015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9838-c7fc-46c3-b518-1bd4cfc312ee None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.980306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9838-c7fc-46c3-b518-1bd4cfc312ee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.980586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9838-c7fc-46c3-b518-1bd4cfc312ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:07.980706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 775/1560] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:07.982528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645e16-1e46-4485-b33c-616c49541d98 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:07.982814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645e16-1e46-4485-b33c-616c49541d98 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:07.983084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645e16-1e46-4485-b33c-616c49541d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.000824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-374a9838-c7fc-46c3-b518-1bd4cfc312ee None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:08.002040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-374a9838-c7fc-46c3-b518-1bd4cfc312ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:08.002603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ae645e16-1e46-4485-b33c-616c49541d98 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:08.003851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ae645e16-1e46-4485-b33c-616c49541d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:08.040359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:08.063276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 786/1561] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:08.067052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9838-c7fc-46c3-b518-1bd4cfc312ee None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.067178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 776/1562] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:08.067178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645e16-1e46-4485-b33c-616c49541d98 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.073274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9838-c7fc-46c3-b518-1bd4cfc312ee None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.077826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645e16-1e46-4485-b33c-616c49541d98 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.078762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.079397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.079676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.079944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.080595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.082470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.082596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.083069 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.083383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.083661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.084346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:08.084650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.085642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:18:08.085642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: warnings.warn(msg) Jul 27 04:18:08.085642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: Jul 27 04:18:08.086525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.098154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 777/1563] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:08.098748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.108451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783b9b-6020-4139-bf26-7d79e9098596 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.114001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.114552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.114959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.115241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.116171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:08.116549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.118176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.119851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:08.123756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 787/1564] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.124751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.134780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 778/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:08.135925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.146180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598c3f-2e1b-4b90-b81a-2f32cdb2a23b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.193954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50aee2-c136-4692-906c-5295c5c70858 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.198749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.199398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.199686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.199966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.201471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.203159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.203293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.203880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.204166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.204443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.205101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.207006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.213045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 788/1566] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:08.214545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.225553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e64cd-cf4d-450a-a3b4-a0ed6847ea1e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.229837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 779/1567] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.230669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.233840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.234469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.234751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.235022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.235743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:08.236047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.237913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.240637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68f1c-f288-440e-8f7d-194672435c62 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.245270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.245871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.246158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.246435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.247845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:08.248270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.249893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.251073 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 789/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:08.256066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.262331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 780/1569] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:08.266543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cebfe-041a-4af0-b97a-b136d04b3887 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.267627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.271612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.272220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.272502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.272775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.273513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:08.273820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.275532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.277074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b758dc-e450-4d81-9782-e1a59ac0f1cb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.282694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.283313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.283616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.283889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.284535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.286410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.287839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 790/1570] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:08.288608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.301156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363aca6-7bc8-451e-a175-ffdf51dade00 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.305665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.306263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.306545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.306855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.307685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.310368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.317659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 781/1571] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.318565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.337955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 791/1572] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/users => generated 303 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.337955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.346438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906545e-eadd-43f4-bd95-b890cc2cb242 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.384462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea512e1-14ec-4f2e-bcf2-72fb00187ff1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.390589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.391500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.391500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.392209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.392401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.394328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.402420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.403084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.403947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.404357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] PATH_INFO: `/v3/projects/0fe580cac8c64220a6d29ac24ec5479e/users/d33ad57b87bf4f74b09d8728dba69a60/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.419020 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe580cac8c64220a6d29ac24ec5479e, user_id=d33ad57b87bf4f74b09d8728dba69a60, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.420160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:18:08.420160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:18:08.420160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:18:08.422236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.422724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 782/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.423591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.425469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:08.438013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 792/1574] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:08 2022] PUT /identity/v3/projects/0fe580cac8c64220a6d29ac24ec5479e/users/d33ad57b87bf4f74b09d8728dba69a60/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:08.438939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.473499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:08.502197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c1e3a-e5be-412c-85f1-b84dd9825391 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.503660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279dc9-71c1-4f4d-9dcf-b6da14c01a85 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.506737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.507388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.507670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.507945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.508286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.508635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.508910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.509197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.509477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.510145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.510259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.512101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.520916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 783/1575] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:08.521934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.532794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381b73a-47e1-4f28-b18a-431eb987bbda admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.537502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.538107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.538386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.538674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.539340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.544571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.544753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 793/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.544753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.569645 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 784/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.570457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.610069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72223-f491-4648-b92e-a46235c4a62c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.632037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86a73-6ec9-424a-84cc-3bccab9418d8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.636727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.637262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.637544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.638391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.639059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.641033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.666063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 785/1578] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.666063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.668673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7f303-c4db-4e79-87f1-95821f1eebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.669324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f303-c4db-4e79-87f1-95821f1eebd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.669611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f303-c4db-4e79-87f1-95821f1eebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.670016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f303-c4db-4e79-87f1-95821f1eebd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.670710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7f303-c4db-4e79-87f1-95821f1eebd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.672656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7f303-c4db-4e79-87f1-95821f1eebd3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.673268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7380f-bccf-45e3-bc9d-cd90234782c1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.677839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.678442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.678727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.679008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.679742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.681324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.691819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 786/1579] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:08.696026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.699430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 794/1580] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.701180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2b21-bb05-48aa-9df2-c3a8b5036ab8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.701627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2b21-bb05-48aa-9df2-c3a8b5036ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.701848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2b21-bb05-48aa-9df2-c3a8b5036ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.706675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1878176-eddc-403a-b0a1-97dd1b1c1fcf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.730862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:08.736425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3e7c2b21-bb05-48aa-9df2-c3a8b5036ab8 None None] MFA Rules not processed for user `d33ad57b87bf4f74b09d8728dba69a60`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:08.738265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3e7c2b21-bb05-48aa-9df2-c3a8b5036ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:08.772299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.772922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.773208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.773484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.774150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.776132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.797963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 787/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.798776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.808313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980de1-c4a4-484b-9a78-d8249c182038 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.811377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 795/1582] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:08.812191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2b21-bb05-48aa-9df2-c3a8b5036ab8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.816783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.817400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.817661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.817933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.818626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.820237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.822601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2b21-bb05-48aa-9df2-c3a8b5036ab8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.827882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.828619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.828903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.829178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.829985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.831970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.832885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 788/1583] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:08.833668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.839464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:08.844867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9d51a-f452-4fab-9294-e4048949418f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.851581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.852188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.852477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.852755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.853418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.854868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 796/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.855387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.855759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.865895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1632d-e814-4e49-9fb8-bf0ec902556e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.871511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.872586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.872872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.873151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.873901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.875535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.881536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 789/1585] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.881536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.889917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 797/1586] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:08.889917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.890166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2842a2-5b09-449b-a256-c73be1c092df admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.894031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.894715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.895001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.895302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.895997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.897599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.897717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb211-49d6-4440-8ecf-6c5a14eb1fc3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.902339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.902930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.903789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.904174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.904819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.906717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.908244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 790/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:08.909052 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.919603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b99149-4791-41d7-b6e5-f9f25e7f6a9f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.925140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.925739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.926044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.926308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.926999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.928620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.933356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 798/1588] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.933356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.939078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 791/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:08.939078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.942339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dfa8f-3614-4723-b4e4-c7fead32ff62 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.945972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.946818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.947096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.947415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.948099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.950026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.951639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bbc95-b534-400c-ac1f-27d7ca7e4540 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:08.956226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:08.956883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:08.957166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:08.957441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] PATH_INFO: `/v3/projects/d923fa1209fa454c8c2e864dea0eb66e/users/9cd6b53763844a699df2eac1918ce42d/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:08.974143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d923fa1209fa454c8c2e864dea0eb66e, user_id=9cd6b53763844a699df2eac1918ce42d, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:08.976927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:08.977055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 799/1590] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:08 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:08.977969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:08.991898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 792/1591] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:08 2022] PUT /identity/v3/projects/d923fa1209fa454c8c2e864dea0eb66e/users/9cd6b53763844a699df2eac1918ce42d/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:08.992771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.044923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a9a3-eabb-4a85-a4e1-722bfc260c2d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.055585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a55c84-64cb-4ad2-a96c-611738c652ad admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.060695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.061308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.061589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.061863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.062548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.064161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.073983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 793/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.074836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.084881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823f2a-8199-43fd-91e9-68723c29c0e1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.088763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:09.091989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.092904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.093193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.093469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.094244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.096189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.106172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 794/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.106778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.107071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.107753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.108136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.108511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.109302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.111590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.119166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd089-1f9a-4599-a9ba-43bc0607afd1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.121905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 800/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.123441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.124450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.125110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.125642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.125924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] PATH_INFO: `/v3/projects/1003eb8992a347cab6d2ca10ef23b045/users/223d7c7974414cc599c968a93f20833e/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.134634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff7a2-7770-49bd-9aee-1011b96144bb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.140404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.140937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.141215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.141418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1003eb8992a347cab6d2ca10ef23b045, user_id=223d7c7974414cc599c968a93f20833e, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.141533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.142152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.143768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.144168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.157049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 795/1595] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:09 2022] PUT /identity/v3/projects/1003eb8992a347cab6d2ca10ef23b045/users/223d7c7974414cc599c968a93f20833e/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:09.161349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 801/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.161486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.161584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.169798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbbf32-e925-4b0b-8635-1a3a886ed361 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.222364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f8579-9ebe-4d15-a35f-90e2ef7f5848 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.224941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.225556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.225841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.226115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.226769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.226968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e75f39-a2b0-416d-b3a0-f57397aadc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.227627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e75f39-a2b0-416d-b3a0-f57397aadc8d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.227899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e75f39-a2b0-416d-b3a0-f57397aadc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.228179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e75f39-a2b0-416d-b3a0-f57397aadc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.228741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.228877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e75f39-a2b0-416d-b3a0-f57397aadc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.230440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e75f39-a2b0-416d-b3a0-f57397aadc8d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.238889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:09.242661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 796/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.244583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff369b3-383d-4b63-87f0-5cb7e849dbef None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.244583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff369b3-383d-4b63-87f0-5cb7e849dbef None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.246459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff369b3-383d-4b63-87f0-5cb7e849dbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.253158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 802/1598] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:09 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:09.253997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.264949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b9e12-f5b4-43de-93e7-2f7027599ab6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.265238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9ff369b3-383d-4b63-87f0-5cb7e849dbef None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:09.266433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9ff369b3-383d-4b63-87f0-5cb7e849dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:09.270661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.271276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.271571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.271911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.272553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.274133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 797/1599] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:09.274290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.274882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff369b3-383d-4b63-87f0-5cb7e849dbef None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.285187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff369b3-383d-4b63-87f0-5cb7e849dbef None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.288367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 803/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.288367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.290315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.291056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.291376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.291655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] PATH_INFO: `/v3/projects/4741242a7711496e97b9ba348c95bff4/users/abe742e3a79e4097b6d5885881df13d1/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.296746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ed907-b6b5-4046-8aef-8ccb5d140ca7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.301320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8593b-87a5-4941-8dd0-d78662f8926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.301915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8593b-87a5-4941-8dd0-d78662f8926b admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.302198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8593b-87a5-4941-8dd0-d78662f8926b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.302476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8593b-87a5-4941-8dd0-d78662f8926b admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.303170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8593b-87a5-4941-8dd0-d78662f8926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.304796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8593b-87a5-4941-8dd0-d78662f8926b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.306936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4741242a7711496e97b9ba348c95bff4, user_id=abe742e3a79e4097b6d5885881df13d1, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.310304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.316203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 804/1601] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.317468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabaf50-8c69-4c40-985c-bd4489e744fa None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.317816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabaf50-8c69-4c40-985c-bd4489e744fa None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.318157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabaf50-8c69-4c40-985c-bd4489e744fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.324500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 798/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:09 2022] PUT /identity/v3/projects/4741242a7711496e97b9ba348c95bff4/users/abe742e3a79e4097b6d5885881df13d1/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:09.325431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.347640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-aaabaf50-8c69-4c40-985c-bd4489e744fa None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:09.348866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-aaabaf50-8c69-4c40-985c-bd4489e744fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:09.386877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f567b6-4137-4029-9a1f-30e0c0e9ad40 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.392380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.392966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.393204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.393486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.394179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.395813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.405765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 799/1603] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.406548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.411833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 805/1604] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:09.412734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabaf50-8c69-4c40-985c-bd4489e744fa None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.415897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105008-d9d8-4fce-a8df-4117e60945ff admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.422331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.422738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabaf50-8c69-4c40-985c-bd4489e744fa None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.422996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.423301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.423587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] PATH_INFO: `/v3/projects/7ff56f92e7094997a43a848efc835ebd/users/1f21d428fab64ca68efa4cf114559ff9/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.427378 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.427994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.428281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.428558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.429253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.430908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.439720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff56f92e7094997a43a848efc835ebd, user_id=1f21d428fab64ca68efa4cf114559ff9, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.444826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 806/1605] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:09.444826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.445079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.446724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:09.456772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 800/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:09 2022] PUT /identity/v3/projects/7ff56f92e7094997a43a848efc835ebd/users/1f21d428fab64ca68efa4cf114559ff9/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:09.457569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.476196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:09.507771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae15bd-cac9-42be-b40e-6e2defc81832 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.521688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f7212-71cd-4b9c-86c7-30e70f1c7adf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.526397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.527061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.527377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.527656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] PATH_INFO: `/v3/projects/1615d3c9a3fd4322903b4898f582fa8b/users/d25dac51d65a4d5d886cceedc213fa7c/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.543014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1615d3c9a3fd4322903b4898f582fa8b, user_id=d25dac51d65a4d5d886cceedc213fa7c, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.546255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.560047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d0099-a0a7-4fa2-9f5c-a4d3fc380f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.560242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 801/1607] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:09 2022] PUT /identity/v3/projects/1615d3c9a3fd4322903b4898f582fa8b/users/d25dac51d65a4d5d886cceedc213fa7c/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:09.560676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d0099-a0a7-4fa2-9f5c-a4d3fc380f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.561040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d0099-a0a7-4fa2-9f5c-a4d3fc380f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.561218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d0099-a0a7-4fa2-9f5c-a4d3fc380f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.561390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.571565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d0099-a0a7-4fa2-9f5c-a4d3fc380f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.573516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d0099-a0a7-4fa2-9f5c-a4d3fc380f66 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.583963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 807/1608] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:09.585105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864a15-e69e-4813-bc2a-f53b0939a875 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.585396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864a15-e69e-4813-bc2a-f53b0939a875 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.585736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864a15-e69e-4813-bc2a-f53b0939a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.590664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:09.615035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-69864a15-e69e-4813-bc2a-f53b0939a875 None None] MFA Rules not processed for user `abe742e3a79e4097b6d5885881df13d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:09.617088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-69864a15-e69e-4813-bc2a-f53b0939a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:09.632824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b018a-4ae7-410a-a891-d77149d62158 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.638461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.639306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.639640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.640025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] PATH_INFO: `/v3/projects/dc1d3b91997546599b14e2d921256c82/users/ce7376d180c047e2b4c8a79e260367e0/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.657932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1d3b91997546599b14e2d921256c82, user_id=ce7376d180c047e2b4c8a79e260367e0, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.660664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.677556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 802/1609] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:09 2022] PUT /identity/v3/projects/dc1d3b91997546599b14e2d921256c82/users/ce7376d180c047e2b4c8a79e260367e0/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:09.681403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.698228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 808/1610] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:09.702497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69864a15-e69e-4813-bc2a-f53b0939a875 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.768908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e28b22-0207-4c7b-943b-73687b5120f6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.776644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.776644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.776644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.776644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] PATH_INFO: `/v3/projects/01d2ea657ec248eda781de0ff45e1b62/users/472dc0170142431792a270ba76056d42/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.777236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69864a15-e69e-4813-bc2a-f53b0939a875 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.808756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:09.810708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d2ea657ec248eda781de0ff45e1b62, user_id=472dc0170142431792a270ba76056d42, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.813614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.828278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 803/1611] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:09 2022] PUT /identity/v3/projects/01d2ea657ec248eda781de0ff45e1b62/users/472dc0170142431792a270ba76056d42/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:09.829508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:09.851891 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1855c-670d-4ec9-bc31-f66fbbbeb70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.852872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1855c-670d-4ec9-bc31-f66fbbbeb70f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.853009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1855c-670d-4ec9-bc31-f66fbbbeb70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.853379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1855c-670d-4ec9-bc31-f66fbbbeb70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.864250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1855c-670d-4ec9-bc31-f66fbbbeb70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.865838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1855c-670d-4ec9-bc31-f66fbbbeb70f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.878775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 809/1612] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:09.880197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59e9d-0a1d-44c1-9ea2-215d67086820 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.880587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59e9d-0a1d-44c1-9ea2-215d67086820 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.880971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59e9d-0a1d-44c1-9ea2-215d67086820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.900276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-29b59e9d-0a1d-44c1-9ea2-215d67086820 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:09.901618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-29b59e9d-0a1d-44c1-9ea2-215d67086820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:09.908226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffb68f-086d-4ea0-9804-53028b746250 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:09.914532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 810/1613] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:09.914532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebbf83-462c-46e8-b477-0228c569f178 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.914532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebbf83-462c-46e8-b477-0228c569f178 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.914532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebbf83-462c-46e8-b477-0228c569f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.916532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271137ac-8e6d-4c20-997c-529fff76b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:09.917385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271137ac-8e6d-4c20-997c-529fff76b87a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.917670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271137ac-8e6d-4c20-997c-529fff76b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.917950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271137ac-8e6d-4c20-997c-529fff76b87a admin admin] PATH_INFO: `/v3/projects/f82695250c874cc38257cc064bf579aa/users/a53e05034d89425794c92c9a37fd7870/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:09.943298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271137ac-8e6d-4c20-997c-529fff76b87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82695250c874cc38257cc064bf579aa, user_id=a53e05034d89425794c92c9a37fd7870, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:09.946048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271137ac-8e6d-4c20-997c-529fff76b87a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:09.961314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-71ebbf83-462c-46e8-b477-0228c569f178 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:09.964683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-71ebbf83-462c-46e8-b477-0228c569f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:09.972647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 804/1614] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:09 2022] PUT /identity/v3/projects/f82695250c874cc38257cc064bf579aa/users/a53e05034d89425794c92c9a37fd7870/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:09.975422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6889a3-bdff-4337-879f-baff9fc3ab46 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:09.975827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6889a3-bdff-4337-879f-baff9fc3ab46 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:09.976701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6889a3-bdff-4337-879f-baff9fc3ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.011927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4e6889a3-bdff-4337-879f-baff9fc3ab46 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:10.014592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4e6889a3-bdff-4337-879f-baff9fc3ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:10.024665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:10.095415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 811/1615] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:10.096358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebbf83-462c-46e8-b477-0228c569f178 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.111671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebbf83-462c-46e8-b477-0228c569f178 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.118493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.119379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.119553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.119833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.120640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.122969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.123133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 805/1616] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:10.124642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89760d65-66a7-4c50-a0e5-9f473e3fdd9c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.125032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89760d65-66a7-4c50-a0e5-9f473e3fdd9c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.125426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89760d65-66a7-4c50-a0e5-9f473e3fdd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.161054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-89760d65-66a7-4c50-a0e5-9f473e3fdd9c None None] MFA Rules not processed for user `472dc0170142431792a270ba76056d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:10.165455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89760d65-66a7-4c50-a0e5-9f473e3fdd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:10.165628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 812/1617] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:10 2022] POST /identity/v3/projects => generated 405 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:10.165628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.246547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339eeec5-3cfe-4230-a69a-9dc6a241c530 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.252452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.253409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.253807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.254209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.290534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 806/1618] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:10.292255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89760d65-66a7-4c50-a0e5-9f473e3fdd9c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.375043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:10.379220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.380956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.394196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 813/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:10.395092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.405831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8388f6a-1939-4894-8a75-c5ca50877af9 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.410153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.410852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.412167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.412167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.416943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89760d65-66a7-4c50-a0e5-9f473e3fdd9c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.423350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.424831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.430536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.431295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.431628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.431896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.432693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.437363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 814/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:10.437525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.438449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.449106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f17aaf-1b16-46f9-85d1-25b128ba45fd service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.457040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688cabb-3db5-4381-8ca3-1bd1e39ff17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.457866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688cabb-3db5-4381-8ca3-1bd1e39ff17a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.458149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688cabb-3db5-4381-8ca3-1bd1e39ff17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.458574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688cabb-3db5-4381-8ca3-1bd1e39ff17a admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.459454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688cabb-3db5-4381-8ca3-1bd1e39ff17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.460986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 807/1621] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:10.462341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688cabb-3db5-4381-8ca3-1bd1e39ff17a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.471521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.498162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 815/1622] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:10 2022] POST /identity/v3/users => generated 309 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:10.501454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2cb7c-f993-4335-ae44-68ec8724a851 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.501740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2cb7c-f993-4335-ae44-68ec8724a851 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.502165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2cb7c-f993-4335-ae44-68ec8724a851 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.502639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef57-8242-4be2-bb8b-97a34b0dd27e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.504117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 816/1623] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 04:18:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:10.504917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2cb7c-f993-4335-ae44-68ec8724a851 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.511691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a45a4a-ecbe-4d12-9bc0-ce13968fc835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.512329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45a4a-ecbe-4d12-9bc0-ce13968fc835 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.512646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45a4a-ecbe-4d12-9bc0-ce13968fc835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.512968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45a4a-ecbe-4d12-9bc0-ce13968fc835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.524013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2cb7c-f993-4335-ae44-68ec8724a851 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.532503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.533506 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.533787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.534116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] PATH_INFO: `/v3/projects/f82695250c874cc38257cc064bf579aa/users/a53e05034d89425794c92c9a37fd7870/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.535460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a45a4a-ecbe-4d12-9bc0-ce13968fc835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.536298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82695250c874cc38257cc064bf579aa, user_id=a53e05034d89425794c92c9a37fd7870, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.538164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a45a4a-ecbe-4d12-9bc0-ce13968fc835 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.539458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.556374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 817/1624] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:10 2022] PUT /identity/v3/projects/f82695250c874cc38257cc064bf579aa/users/a53e05034d89425794c92c9a37fd7870/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:10.557485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.580696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 808/1625] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:10.583965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482840d3-dfac-431e-9133-3965e3707dfb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.585071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482840d3-dfac-431e-9133-3965e3707dfb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.586758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482840d3-dfac-431e-9133-3965e3707dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.671879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054763d-29b7-46be-a5c1-a57eef8ecd87 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.675806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-482840d3-dfac-431e-9133-3965e3707dfb None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:10.677227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-482840d3-dfac-431e-9133-3965e3707dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:10.678588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd1a57-3d7b-455a-b3eb-e1e353dfd647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.679452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd1a57-3d7b-455a-b3eb-e1e353dfd647 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.680004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd1a57-3d7b-455a-b3eb-e1e353dfd647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.680553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd1a57-3d7b-455a-b3eb-e1e353dfd647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.681491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd1a57-3d7b-455a-b3eb-e1e353dfd647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.683967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd1a57-3d7b-455a-b3eb-e1e353dfd647 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.690967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:10.705434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 818/1626] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:10.710713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec94a8-9a41-4a29-8ecc-e6c21d9653df None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.711023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec94a8-9a41-4a29-8ecc-e6c21d9653df None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.711563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec94a8-9a41-4a29-8ecc-e6c21d9653df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.772102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-47ec94a8-9a41-4a29-8ecc-e6c21d9653df None None] MFA Rules not processed for user `a53e05034d89425794c92c9a37fd7870`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:10.775165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-47ec94a8-9a41-4a29-8ecc-e6c21d9653df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:10.855388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 809/1627] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:10.856448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482840d3-dfac-431e-9133-3965e3707dfb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.876648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482840d3-dfac-431e-9133-3965e3707dfb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.882675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.883879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.884431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.884922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] PATH_INFO: `/v3/projects/c6c3e5cb0b0a4d5a9c0ce4a066405cfe/users/89f62b587f334d95adcf2e771d62626d/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.894893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 819/1628] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:10.895866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec94a8-9a41-4a29-8ecc-e6c21d9653df None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.907487 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c3e5cb0b0a4d5a9c0ce4a066405cfe, user_id=89f62b587f334d95adcf2e771d62626d, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:10.911065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:10.922037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec94a8-9a41-4a29-8ecc-e6c21d9653df None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:10.929783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:10.930596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:10.930889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:10.931180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:10.943496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 810/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:10 2022] PUT /identity/v3/projects/c6c3e5cb0b0a4d5a9c0ce4a066405cfe/users/89f62b587f334d95adcf2e771d62626d/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:10.945294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:10.974989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:11.017257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:11.020566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:11.037733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 820/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:11.038613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:11.041154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7208c-8c15-400b-9fab-443c49a895da admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:11.052543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cbb0a-9ec6-4352-9ed8-5aa50964fb75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:11.053238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05633c6e-0c94-475f-b173-50bd5a771e36 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:11.054171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cbb0a-9ec6-4352-9ed8-5aa50964fb75 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.054457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cbb0a-9ec6-4352-9ed8-5aa50964fb75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.054725 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cbb0a-9ec6-4352-9ed8-5aa50964fb75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.133964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:11.134609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.134885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.135165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.136065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:11.138178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:11.158199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 821/1631] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:11.159388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:11.172023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb059b1-e595-440b-b522-71fc0ef884be admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:11.180208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14925276-1034-4a8c-add9-c51ca4eaddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:11.180816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925276-1034-4a8c-add9-c51ca4eaddab admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.181097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925276-1034-4a8c-add9-c51ca4eaddab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.181461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925276-1034-4a8c-add9-c51ca4eaddab admin admin] PATH_INFO: `/v3/projects/c6c3e5cb0b0a4d5a9c0ce4a066405cfe/users/89f62b587f334d95adcf2e771d62626d/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.191784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14925276-1034-4a8c-add9-c51ca4eaddab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c3e5cb0b0a4d5a9c0ce4a066405cfe, user_id=89f62b587f334d95adcf2e771d62626d, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:11.195445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14925276-1034-4a8c-add9-c51ca4eaddab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:11.215435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cbb0a-9ec6-4352-9ed8-5aa50964fb75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:11.221005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cbb0a-9ec6-4352-9ed8-5aa50964fb75 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:11.227064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 822/1632] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:11 2022] PUT /identity/v3/projects/c6c3e5cb0b0a4d5a9c0ce4a066405cfe/users/89f62b587f334d95adcf2e771d62626d/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:11.240071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625fe2d-1c92-4d70-84c2-048c8c0c3470 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.240484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625fe2d-1c92-4d70-84c2-048c8c0c3470 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.240870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625fe2d-1c92-4d70-84c2-048c8c0c3470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.250558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 811/1633] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:11.319845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c625fe2d-1c92-4d70-84c2-048c8c0c3470 None None] MFA Rules not processed for user `89f62b587f334d95adcf2e771d62626d`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:11.321656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c625fe2d-1c92-4d70-84c2-048c8c0c3470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:11.398445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5182c-4fe1-4848-aa1b-a286377c77a5 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.398657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5182c-4fe1-4848-aa1b-a286377c77a5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.398869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5182c-4fe1-4848-aa1b-a286377c77a5 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.400481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 812/1634] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 04:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:18:11.408315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f560a28-f872-4c29-aea4-7c5f73e8241c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.408628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f560a28-f872-4c29-aea4-7c5f73e8241c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.408862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f560a28-f872-4c29-aea4-7c5f73e8241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.467446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8f560a28-f872-4c29-aea4-7c5f73e8241c None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:11.470146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8f560a28-f872-4c29-aea4-7c5f73e8241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:11.489275 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 823/1635] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:11.501298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625fe2d-1c92-4d70-84c2-048c8c0c3470 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:11.533684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:11.594459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 813/1636] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:18:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:11.639328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:11.664309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f560a28-f872-4c29-aea4-7c5f73e8241c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:11.679814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625fe2d-1c92-4d70-84c2-048c8c0c3470 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:11.681545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f560a28-f872-4c29-aea4-7c5f73e8241c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:11.686146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:11.686745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.687077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.687387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.690434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:11.691331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:11.692222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:11.692510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:11.704677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:11.707909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:11.718098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:11.719688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:11.736830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 814/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:18:11.763892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 824/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:18:12.230268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:12.405008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5b24-c64d-4f7a-900c-48b4ea04176c service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:12.423959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:12.428198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:12.428198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:12.428408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] PATH_INFO: `/v3/users/abe742e3a79e4097b6d5885881df13d1` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:12.435141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe742e3a79e4097b6d5885881df13d1)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:12.439980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:12.547771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:12.561821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689d07-e54f-42e5-a5cc-201d6c256948 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:12.576282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:12.576998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:12.577282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:12.577577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] PATH_INFO: `/v3/users/d33ad57b87bf4f74b09d8728dba69a60` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:12.580734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe742e3a79e4097b6d5885881df13d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.588166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33ad57b87bf4f74b09d8728dba69a60)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:12.592898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: WARNING py.warnings [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:18:12.592898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: warnings.warn(msg) Jul 27 04:18:12.592898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: Jul 27 04:18:12.594180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:12.597923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe742e3a79e4097b6d5885881df13d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.610115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe742e3a79e4097b6d5885881df13d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.611178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe742e3a79e4097b6d5885881df13d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.626629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-82e158ec-dabe-4046-81bf-8f70f56e6037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe742e3a79e4097b6d5885881df13d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.667516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 815/1639] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:12 2022] DELETE /identity/v3/users/abe742e3a79e4097b6d5885881df13d1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:12.670189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995da4-7320-4d2c-80b1-7306c5f1e6eb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:12.670633 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995da4-7320-4d2c-80b1-7306c5f1e6eb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:12.670922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f995da4-7320-4d2c-80b1-7306c5f1e6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:12.709935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5f995da4-7320-4d2c-80b1-7306c5f1e6eb None None] MFA Rules not processed for user `223d7c7974414cc599c968a93f20833e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:12.711589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5f995da4-7320-4d2c-80b1-7306c5f1e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:12.731178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:12.793391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33ad57b87bf4f74b09d8728dba69a60'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.799664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33ad57b87bf4f74b09d8728dba69a60'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.802773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33ad57b87bf4f74b09d8728dba69a60'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.823002 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 816/1640] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:12.838176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd2180-079a-4e5c-9862-6a99f6aaf628 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:12.838433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd2180-079a-4e5c-9862-6a99f6aaf628 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:12.838726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd2180-079a-4e5c-9862-6a99f6aaf628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:12.908155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33ad57b87bf4f74b09d8728dba69a60'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.917607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8fbd2180-079a-4e5c-9862-6a99f6aaf628 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:12.917607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8fbd2180-079a-4e5c-9862-6a99f6aaf628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:12.949183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33ad57b87bf4f74b09d8728dba69a60'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:12.986835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 825/1641] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:12 2022] DELETE /identity/v3/users/d33ad57b87bf4f74b09d8728dba69a60 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:12.988335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:12.991385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:13.097249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 817/1642] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:13.098691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.098987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.099376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.126136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee3d9-4091-4528-810d-a4bf4528dfdf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.136274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.138463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.138924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.139349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.140733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.150538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.159770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:13.161013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:13.208237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 818/1643] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:13.212026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.218806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:13.243521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 826/1644] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:12 2022] POST /identity/v3/projects => generated 403 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:13.245384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.247708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:13.313033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2c4a8-c91c-4c1f-89da-f34082235ef3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.324775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:13.347318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2cb0b-8021-46d0-9014-8bfe2ba1338f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.352936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.353579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.353860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.354138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.375833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.376539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.376826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.377171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.406223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:13.451451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.452931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.464649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 827/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:13.466051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.476974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db126e-9a0e-40d0-8c8e-ec1a1717d90a service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.483164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.483885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.484208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.484487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.485395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.487716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.512852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 828/1646] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:13 2022] POST /identity/v3/users => generated 308 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:13.516689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.533714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c844-705a-4ae9-ad41-7ddbd2a305de admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.535952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.538831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.546050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0ccd1-7525-4c80-aeb6-d5caaa42be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.548249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0ccd1-7525-4c80-aeb6-d5caaa42be8e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.549105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0ccd1-7525-4c80-aeb6-d5caaa42be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.549105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0ccd1-7525-4c80-aeb6-d5caaa42be8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.551403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0ccd1-7525-4c80-aeb6-d5caaa42be8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.554954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0ccd1-7525-4c80-aeb6-d5caaa42be8e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.565167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 819/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:13.581451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.589406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 829/1648] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:13.595362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41b81-a0a1-45f3-8af8-f75f64c00b03 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.601957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.602586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.602912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.603191 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] PATH_INFO: `/v3/projects/565901834a9040d2a2418414a6af0cc6/users/7d8830e82bf247f1b2270eedcc2ee5ce/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.629634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565901834a9040d2a2418414a6af0cc6, user_id=7d8830e82bf247f1b2270eedcc2ee5ce, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.635439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717887c-deae-437e-9231-28ff97dba631 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.636260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717887c-deae-437e-9231-28ff97dba631 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.638328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717887c-deae-437e-9231-28ff97dba631 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.640350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 830/1649] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 04:18:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:13.643031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.660165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8276-72bb-408a-a237-fdf51822e411 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.660750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8276-72bb-408a-a237-fdf51822e411 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.661142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8276-72bb-408a-a237-fdf51822e411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.682863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 820/1650] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:13 2022] PUT /identity/v3/projects/565901834a9040d2a2418414a6af0cc6/users/7d8830e82bf247f1b2270eedcc2ee5ce/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:13.684097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.712701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f64b8276-72bb-408a-a237-fdf51822e411 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:13.728958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f64b8276-72bb-408a-a237-fdf51822e411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:13.833366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666d92-c557-467c-8fc6-eee287252051 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.847075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 831/1651] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:13.847876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.849679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.849967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.850284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.852067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.853603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429b91d-c2e2-4231-b00c-230a42ab4371 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.854063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.854202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429b91d-c2e2-4231-b00c-230a42ab4371 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.854601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429b91d-c2e2-4231-b00c-230a42ab4371 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.857861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 832/1652] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 04:18:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 04:18:13.864133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.864582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.865108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.874172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 821/1653] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:13.875791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.891875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f406f-c300-4ca4-80f0-da370203b597 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:13.900515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:13.901835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:13.903151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:13.904327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:13.904618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:13.904899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] PATH_INFO: `/v3/projects/565901834a9040d2a2418414a6af0cc6/users/7d8830e82bf247f1b2270eedcc2ee5ce/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:13.913222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=565901834a9040d2a2418414a6af0cc6, user_id=7d8830e82bf247f1b2270eedcc2ee5ce, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:13.913921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 833/1654] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:13.916429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:13.937520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:13.939717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:13.949064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 822/1655] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:13 2022] PUT /identity/v3/projects/565901834a9040d2a2418414a6af0cc6/users/7d8830e82bf247f1b2270eedcc2ee5ce/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:14.010114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:14.031933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85469411-11d9-4329-a864-5fe4dd67ee5b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:14.104374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:14.104739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:14.105084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:14.105371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:14.217308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:14.219014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:14.238974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 834/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:18:15.012040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:15.016097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:15.302493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ffbc0-f20f-40bb-be53-9615b84b7deb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:15.312955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:15.313743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:15.314108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:15.314435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] PATH_INFO: `/v3/projects/0fe580cac8c64220a6d29ac24ec5479e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:15.324046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe580cac8c64220a6d29ac24ec5479e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:15.327211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: WARNING py.warnings [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 04:18:15.327211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: warnings.warn(msg) Jul 27 04:18:15.327211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: Jul 27 04:18:15.328612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:15.402402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:15.529788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe580cac8c64220a6d29ac24ec5479e', 'request_id': 'req-44781d5f-4f28-46b0-82e0-4e46a8e948a2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.564990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe580cac8c64220a6d29ac24ec5479e', 'request_id': 'req-44781d5f-4f28-46b0-82e0-4e46a8e948a2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.578878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe580cac8c64220a6d29ac24ec5479e', 'request_id': 'req-44781d5f-4f28-46b0-82e0-4e46a8e948a2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.608459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] The token cache is being invalidate because project 0fe580cac8c64220a6d29ac24ec5479e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:15.609304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.610076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.615507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 823/1657] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:15 2022] DELETE /identity/v3/projects/0fe580cac8c64220a6d29ac24ec5479e => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:15.616979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:15.638761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10789bc-b01f-4181-b24f-165bfccbe3e1 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:15.772272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:15.772532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:15.772819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:15.773546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] PATH_INFO: `/v3/users/a53e05034d89425794c92c9a37fd7870` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:15.775993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53e05034d89425794c92c9a37fd7870)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:15.778644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:15.902217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:15.907290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53e05034d89425794c92c9a37fd7870'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.908418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53e05034d89425794c92c9a37fd7870'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.909420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53e05034d89425794c92c9a37fd7870'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.941753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53e05034d89425794c92c9a37fd7870'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.958200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53e05034d89425794c92c9a37fd7870'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:15.981572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 835/1658] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:15 2022] DELETE /identity/v3/users/a53e05034d89425794c92c9a37fd7870 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:16.035354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:16.037322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:16.066989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44781d5f-4f28-46b0-82e0-4e46a8e948a2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:16.151579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:16.152424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:16.153004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:16.153616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] PATH_INFO: `/v3/projects/4741242a7711496e97b9ba348c95bff4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:16.155425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4741242a7711496e97b9ba348c95bff4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:16.158983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:16.266480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4741242a7711496e97b9ba348c95bff4', 'request_id': 'req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.276910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4741242a7711496e97b9ba348c95bff4', 'request_id': 'req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.287594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4741242a7711496e97b9ba348c95bff4', 'request_id': 'req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.306738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] The token cache is being invalidate because project 4741242a7711496e97b9ba348c95bff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:16.307162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.308031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.316184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 824/1659] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:16 2022] DELETE /identity/v3/projects/4741242a7711496e97b9ba348c95bff4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:16.316373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:16.318124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:16.337510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f2001-2929-4293-a6fb-52ddb0ae6789 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:16.441549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:16.442446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:16.442875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:16.443428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] PATH_INFO: `/v3/users/89f62b587f334d95adcf2e771d62626d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:16.444969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f62b587f334d95adcf2e771d62626d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:16.461223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:16.561491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f62b587f334d95adcf2e771d62626d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.564068 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f62b587f334d95adcf2e771d62626d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.564645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f62b587f334d95adcf2e771d62626d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.604066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f62b587f334d95adcf2e771d62626d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.628236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f62b587f334d95adcf2e771d62626d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:16.666988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 836/1660] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:16 2022] DELETE /identity/v3/users/89f62b587f334d95adcf2e771d62626d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:18:17.807643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:17.810612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:17.828138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb438-9f64-46eb-88c0-28ee8cff06d0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:17.991237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:17.991237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:17.999354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:18.062660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:18.063382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.063722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.064010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] PATH_INFO: `/v3/projects/c6c3e5cb0b0a4d5a9c0ce4a066405cfe` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.066213 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c3e5cb0b0a4d5a9c0ce4a066405cfe)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:18.070736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:18.107473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:18.166491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b545b7-9a1d-408b-8f51-579f1673423a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:18.190833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c3e5cb0b0a4d5a9c0ce4a066405cfe', 'request_id': 'req-e8560d9f-8c18-4a17-b1c2-cf926a44e059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.222246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c3e5cb0b0a4d5a9c0ce4a066405cfe', 'request_id': 'req-e8560d9f-8c18-4a17-b1c2-cf926a44e059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.243678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c3e5cb0b0a4d5a9c0ce4a066405cfe', 'request_id': 'req-e8560d9f-8c18-4a17-b1c2-cf926a44e059'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.268962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] The token cache is being invalidate because project c6c3e5cb0b0a4d5a9c0ce4a066405cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:18.272019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.275196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8560d9f-8c18-4a17-b1c2-cf926a44e059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.280241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 825/1661] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:17 2022] DELETE /identity/v3/projects/c6c3e5cb0b0a4d5a9c0ce4a066405cfe => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:18.288469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dfa19-d334-480e-9171-bd34c07ef243 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.288768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dfa19-d334-480e-9171-bd34c07ef243 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.290203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dfa19-d334-480e-9171-bd34c07ef243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.299712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:18.300574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.300831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.301158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] PATH_INFO: `/v3/users/472dc0170142431792a270ba76056d42` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.302668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] RBAC: Authorizing `identity:delete_user(user_id=472dc0170142431792a270ba76056d42)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:18.304935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:18.334727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-405dfa19-d334-480e-9171-bd34c07ef243 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:18.336007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-405dfa19-d334-480e-9171-bd34c07ef243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:18.360043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 826/1662] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:18.368447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e93a0-c7de-425f-a3d8-4a85d3ce545c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.368908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e93a0-c7de-425f-a3d8-4a85d3ce545c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.369248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e93a0-c7de-425f-a3d8-4a85d3ce545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.388262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472dc0170142431792a270ba76056d42'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.391932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472dc0170142431792a270ba76056d42'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.393936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472dc0170142431792a270ba76056d42'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.413704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-405e93a0-c7de-425f-a3d8-4a85d3ce545c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:18.414952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-405e93a0-c7de-425f-a3d8-4a85d3ce545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:18.427816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472dc0170142431792a270ba76056d42'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.434559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 827/1663] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:18:18.439279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e93a0-c7de-425f-a3d8-4a85d3ce545c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:18.447751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa4c8be6-9ad4-4e79-ac0c-048ab911908e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472dc0170142431792a270ba76056d42'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:18.455059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e93a0-c7de-425f-a3d8-4a85d3ce545c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:18.462324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:18.462979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.463298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.463554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.464260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:18.464584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:18.471241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:18.471985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 837/1664] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:17 2022] DELETE /identity/v3/users/472dc0170142431792a270ba76056d42 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:18.474029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.474670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.475088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.499961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:18.501394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:18.502143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 828/1665] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:18:18.506309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:18.524880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e6e16-3e5c-4f64-80e3-a2fb9c02b984 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:18.602169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 838/1666] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:18.623637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:18.625091 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:18.642389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:18.658554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:18.659582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.659936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.660286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.661263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:18.667628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:18.752460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 829/1667] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:18 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:18:18.753429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:18.786567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d17c3-38cc-45d0-980d-11f76ed542ac None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:18.850907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:18.891035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:18.891782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.892528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.892528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.954239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104cc41-2681-4336-b59f-707f1332527b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:18.965318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:18.966433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:18.966827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:18.967215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:18.968195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:18.977081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:18.992086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:18.994813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:19.007541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 839/1668] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:19.038908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 830/1669] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:18 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:19.042873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:19.060831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840253a7-4914-4e9f-a39e-4f3f3073caf0 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:19.073521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:19.074261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:19.075094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:19.075497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:19.076540 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:19.078206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:19.099543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 840/1670] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:19.101895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:19.116143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017c825-d5d9-45a1-8d72-ea70ceac9fd4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:19.123206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc3764-c435-4fa5-916d-ffcfde9e334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:19.123640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc3764-c435-4fa5-916d-ffcfde9e334a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:19.124060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc3764-c435-4fa5-916d-ffcfde9e334a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:19.124482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc3764-c435-4fa5-916d-ffcfde9e334a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:19.125636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc3764-c435-4fa5-916d-ffcfde9e334a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:19.128299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc3764-c435-4fa5-916d-ffcfde9e334a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:19.151200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 831/1671] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:19.152845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:19.177370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd6e3c-6772-4385-9334-76bd4a112c76 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:19.192123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:19.193043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:19.193970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:19.194583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] PATH_INFO: `/v3/projects/0d63531c6f7b4fe7b805c6c9cb245148/users/d83003c4a59c40e3b88ac7e670106ca8/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:19.234261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d63531c6f7b4fe7b805c6c9cb245148, user_id=d83003c4a59c40e3b88ac7e670106ca8, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:19.237778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:19.292882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:19.293301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:19.293737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:19.294375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 841/1672] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:19 2022] PUT /identity/v3/projects/0d63531c6f7b4fe7b805c6c9cb245148/users/d83003c4a59c40e3b88ac7e670106ca8/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:18:19.387117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] MFA Rules not processed for user `d83003c4a59c40e3b88ac7e670106ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:19.398528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:19.663911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:19.671045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 832/1673] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:18:19.706699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:19.710320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:19.794254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:19.867303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3545c5-5e14-4887-9862-3b3bd9eb7892 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:19.883303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:19.884306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:19.884722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:19.885140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] PATH_INFO: `/v3/projects/f82695250c874cc38257cc064bf579aa` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:19.886734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82695250c874cc38257cc064bf579aa)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:19.889680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcf10-16fc-4e13-befd-a7136130657d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:19.892828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:19.904191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:19.905280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:19.905932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:19.906386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:19.908448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:19.913334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:19.967084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:19.977380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 842/1674] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:19 2022] POST /identity/v3/projects => generated 381 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:19.978890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:19.993129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82695250c874cc38257cc064bf579aa', 'request_id': 'req-deb5d02e-9207-45a1-9fde-79353132e593'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:20.008145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82695250c874cc38257cc064bf579aa', 'request_id': 'req-deb5d02e-9207-45a1-9fde-79353132e593'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:20.018687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82695250c874cc38257cc064bf579aa', 'request_id': 'req-deb5d02e-9207-45a1-9fde-79353132e593'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:20.068876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] The token cache is being invalidate because project f82695250c874cc38257cc064bf579aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:20.071855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:20.073059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-deb5d02e-9207-45a1-9fde-79353132e593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:20.075408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 833/1675] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:19 2022] DELETE /identity/v3/projects/f82695250c874cc38257cc064bf579aa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:20.084938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3540ef-b4b0-4b97-ba34-2c49893e3a6e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.085167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3540ef-b4b0-4b97-ba34-2c49893e3a6e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.085448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3540ef-b4b0-4b97-ba34-2c49893e3a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.116323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-df3540ef-b4b0-4b97-ba34-2c49893e3a6e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:20.117566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-df3540ef-b4b0-4b97-ba34-2c49893e3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:20.122431 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f7b57-2206-46c9-9ca3-c711902521fc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.131152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 834/1676] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:20.142974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.144047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.144950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893ab6-9a30-4ff1-8062-5ed79ae56f6a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.145316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893ab6-9a30-4ff1-8062-5ed79ae56f6a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.145665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893ab6-9a30-4ff1-8062-5ed79ae56f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.146542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.146911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.148929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.156136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.176660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2a893ab6-9a30-4ff1-8062-5ed79ae56f6a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:20.178151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2a893ab6-9a30-4ff1-8062-5ed79ae56f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:20.194109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 835/1677] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:20.201101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893ab6-9a30-4ff1-8062-5ed79ae56f6a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.202072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 843/1678] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:19 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:20.205976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.207752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:20.231052 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893ab6-9a30-4ff1-8062-5ed79ae56f6a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.236119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2398d34-92c4-4c6d-bfb7-c8bb34c4f004 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.241071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.241902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.241999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.242266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.243240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:20.243663 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.245427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.253288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.254216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.254216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.254519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.255171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.256821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.272634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 836/1679] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:20.278275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.291365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 844/1680] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:20.294841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.298059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd8ef-0698-4bea-8135-ffe43ec78952 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.311341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556e5c6-61fe-47be-8c52-7e2446efaeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.311996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e5c6-61fe-47be-8c52-7e2446efaeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.312286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e5c6-61fe-47be-8c52-7e2446efaeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.312566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e5c6-61fe-47be-8c52-7e2446efaeb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.313256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556e5c6-61fe-47be-8c52-7e2446efaeb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.315458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc03dd-2bc5-4302-808b-938794933dab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.315651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556e5c6-61fe-47be-8c52-7e2446efaeb0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.332114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.332808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.333086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.333364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] PATH_INFO: `/v3/projects/2b3f99ea7e1f4fb8bd18d2ef621fb25a/users/85dfbd86fc714c9986eca3c0cb436e12/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.378219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3f99ea7e1f4fb8bd18d2ef621fb25a, user_id=85dfbd86fc714c9986eca3c0cb436e12, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.380999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.400581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 837/1681] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:20 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:20.403811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351623c-45c6-4b68-8119-3422b9795844 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.404724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351623c-45c6-4b68-8119-3422b9795844 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.405178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351623c-45c6-4b68-8119-3422b9795844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.408906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 845/1682] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:20 2022] PUT /identity/v3/projects/2b3f99ea7e1f4fb8bd18d2ef621fb25a/users/85dfbd86fc714c9986eca3c0cb436e12/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:18:20.409495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.461497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d351623c-45c6-4b68-8119-3422b9795844 None None] MFA Rules not processed for user `7d8830e82bf247f1b2270eedcc2ee5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:20.464827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d351623c-45c6-4b68-8119-3422b9795844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:20.573896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8409da-5491-4717-9c54-ca2a79a39d20 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.588471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.588471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.588867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.589146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.589820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.594761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.644760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 846/1683] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:20 2022] POST /identity/v3/users => generated 282 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:20.645629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.662872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 838/1684] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:20.663802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351623c-45c6-4b68-8119-3422b9795844 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.675920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2207cf-d6ee-4417-a978-7a8f6400cf6c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.694393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351623c-45c6-4b68-8119-3422b9795844 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.705525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.706166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.706444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.706715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.707443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.709106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.710712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:20.720706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.728258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.728651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.728791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.729536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.732616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.751903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 847/1685] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:20.752488 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.765299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 839/1686] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:20.769314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.789067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666b988-ef5f-4c85-9708-9da3bb223be6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.791109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea996f-50d1-4a44-92e4-5ee8111bfe7b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.797791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.798431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.798715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.798984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.799723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.801344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.815603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1e88d-a823-4001-8f27-c3b348480a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:20.816311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1e88d-a823-4001-8f27-c3b348480a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.816790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1e88d-a823-4001-8f27-c3b348480a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.816898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1e88d-a823-4001-8f27-c3b348480a7b admin admin] PATH_INFO: `/v3/projects/2b3f99ea7e1f4fb8bd18d2ef621fb25a/users/85dfbd86fc714c9986eca3c0cb436e12/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.820510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1e88d-a823-4001-8f27-c3b348480a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3f99ea7e1f4fb8bd18d2ef621fb25a, user_id=85dfbd86fc714c9986eca3c0cb436e12, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:20.824357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1e88d-a823-4001-8f27-c3b348480a7b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:20.828849 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 840/1687] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:18:20.829995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:20.863114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 848/1688] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:20 2022] PUT /identity/v3/projects/2b3f99ea7e1f4fb8bd18d2ef621fb25a/users/85dfbd86fc714c9986eca3c0cb436e12/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:20.863337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5d692-8e71-43d9-84d1-302e30c192cf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:20.865617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:20.865908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:20.866192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:20.925897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] MFA Rules not processed for user `85dfbd86fc714c9986eca3c0cb436e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:20.932120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:20.936058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:21.002178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dbe30-5d3a-4767-aabf-91d446652d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:21.002873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dbe30-5d3a-4767-aabf-91d446652d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:21.003153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dbe30-5d3a-4767-aabf-91d446652d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:21.003462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dbe30-5d3a-4767-aabf-91d446652d1c admin admin] PATH_INFO: `/v3/projects/966593cc803343f1b6a3c548f351fbfb/users/461233b24af24e53bc0ca2fb01233ba4/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:21.037831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dbe30-5d3a-4767-aabf-91d446652d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=966593cc803343f1b6a3c548f351fbfb, user_id=461233b24af24e53bc0ca2fb01233ba4, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:21.041334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dbe30-5d3a-4767-aabf-91d446652d1c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:21.069419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 841/1689] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:20 2022] PUT /identity/v3/projects/966593cc803343f1b6a3c548f351fbfb/users/461233b24af24e53bc0ca2fb01233ba4/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:18:21.080172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff1d0-124e-4f01-9c5f-d30f4fdf9145 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:21.080466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff1d0-124e-4f01-9c5f-d30f4fdf9145 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:21.080756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff1d0-124e-4f01-9c5f-d30f4fdf9145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:21.127623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 849/1690] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:21.138845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:21.141070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bb2ff1d0-124e-4f01-9c5f-d30f4fdf9145 None None] MFA Rules not processed for user `461233b24af24e53bc0ca2fb01233ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:21.142332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bb2ff1d0-124e-4f01-9c5f-d30f4fdf9145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:21.144543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:21.284415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ab17d-6e2d-44b5-ba1b-dab37f92bd45 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:21.308607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 842/1691] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:18:21.313613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff1d0-124e-4f01-9c5f-d30f4fdf9145 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:21.462964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:21.467033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:21.467033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:21.467407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:21.521707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff1d0-124e-4f01-9c5f-d30f4fdf9145 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:21.539794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:21.540595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:21.540985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:21.541466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:21.542239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:21.546903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:21.549805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:21.589531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:21.591740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:21.619968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 850/1692] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:21.622560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:21.626156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:21.635237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 843/1693] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:21 2022] POST /identity/v3/projects => generated 365 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:21.639718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:21.666750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a84fc-1494-44fd-986f-a8a8a5e501a3 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:21.785185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:21.801673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:21.802489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:21.802785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:21.803092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] PATH_INFO: `/v3/projects/01d2ea657ec248eda781de0ff45e1b62` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:21.804693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d2ea657ec248eda781de0ff45e1b62)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:21.807297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:21.849323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b7c21-7a83-4846-8f50-c7df016f0577 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:21.866352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:21.867002 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:21.867421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:21.867805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:21.868709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:21.870909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:21.913380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 844/1694] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:21 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:21.920879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:21.936818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d2ea657ec248eda781de0ff45e1b62', 'request_id': 'req-890f0570-1313-4f85-b49f-918162aebf39'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:21.944422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d2ea657ec248eda781de0ff45e1b62', 'request_id': 'req-890f0570-1313-4f85-b49f-918162aebf39'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:21.961289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50c976-8af9-4256-a540-2193456571b2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:21.967026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d2ea657ec248eda781de0ff45e1b62', 'request_id': 'req-890f0570-1313-4f85-b49f-918162aebf39'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:21.984655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] The token cache is being invalidate because project 01d2ea657ec248eda781de0ff45e1b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:21.985133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:21.988614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-890f0570-1313-4f85-b49f-918162aebf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:21.991455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 851/1695] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:21 2022] DELETE /identity/v3/projects/01d2ea657ec248eda781de0ff45e1b62 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:22.000819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429c7c-6ba6-4462-9810-7c650d0f8a80 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.001113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429c7c-6ba6-4462-9810-7c650d0f8a80 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.001393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429c7c-6ba6-4462-9810-7c650d0f8a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.061846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-37429c7c-6ba6-4462-9810-7c650d0f8a80 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:22.063049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-37429c7c-6ba6-4462-9810-7c650d0f8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:22.152094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:22.155657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.155937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.156207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.156937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:22.158593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:22.206084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 845/1696] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:22.208519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.211481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:22.262939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9f976-d8e0-47ba-9ef8-a39ffbb29f11 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:22.281364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 852/1697] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:22.282975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087fff3-c96a-414a-bc35-14059a736d01 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.283288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087fff3-c96a-414a-bc35-14059a736d01 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.283635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087fff3-c96a-414a-bc35-14059a736d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.284807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:22.285780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.288444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.288994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] PATH_INFO: `/v3/projects/8ee66cdbad2548b09a03bf11a4fc026c/users/9a3e06823d1643d4b0c69c9bfc29b85d/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.311983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:22.349348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d087fff3-c96a-414a-bc35-14059a736d01 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:22.350444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d087fff3-c96a-414a-bc35-14059a736d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:22.368333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee66cdbad2548b09a03bf11a4fc026c, user_id=9a3e06823d1643d4b0c69c9bfc29b85d, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:22.378612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:22.391009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 853/1698] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:22.396026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087fff3-c96a-414a-bc35-14059a736d01 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.407806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 846/1699] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:22 2022] PUT /identity/v3/projects/8ee66cdbad2548b09a03bf11a4fc026c/users/9a3e06823d1643d4b0c69c9bfc29b85d/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:22.411833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.417808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087fff3-c96a-414a-bc35-14059a736d01 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:22.540377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c347608-5af0-41c7-a92e-5cdfba1ff890 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:22.549041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:22.550294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.550294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.550594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.551780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:22.553498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:22.554278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.554472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:22.554581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.555154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.555714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:22.556025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:22.557637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:22.572768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 847/1700] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:22.572768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.573004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:22.589972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 854/1701] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:22.591444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.616082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cacf02-680c-442e-b395-d500adfcc27d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:22.630824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:22.631039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:22.631548 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.631895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.632224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] PATH_INFO: `/v3/projects/8ee66cdbad2548b09a03bf11a4fc026c/users/9a3e06823d1643d4b0c69c9bfc29b85d/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.638413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee66cdbad2548b09a03bf11a4fc026c, user_id=9a3e06823d1643d4b0c69c9bfc29b85d, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:22.641478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:22.670230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 855/1702] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:22 2022] PUT /identity/v3/projects/8ee66cdbad2548b09a03bf11a4fc026c/users/9a3e06823d1643d4b0c69c9bfc29b85d/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:22.670990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.678114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461b587-9f25-4a69-a089-4b9f52578653 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:22.763948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437cabd-5ed1-4d71-9372-5065492c012a tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfbd86fc714c9986eca3c0cb436e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b3f99ea7e1f4fb8bd18d2ef621fb25a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:22.764925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437cabd-5ed1-4d71-9372-5065492c012a tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.765225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437cabd-5ed1-4d71-9372-5065492c012a tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.766515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437cabd-5ed1-4d71-9372-5065492c012a tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.767421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437cabd-5ed1-4d71-9372-5065492c012a tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:22.767984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437cabd-5ed1-4d71-9372-5065492c012a tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:22.769723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437cabd-5ed1-4d71-9372-5065492c012a tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:22.788257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 848/1703] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:22.788257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735b05-7f60-46e9-8a90-951f9df27b4c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.788563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735b05-7f60-46e9-8a90-951f9df27b4c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.789266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735b05-7f60-46e9-8a90-951f9df27b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.813871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0f4b8-f3e0-49af-a31f-de8cfad8518d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:22.819693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:22.820332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:22.820616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:22.820892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:22.821580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:22.824034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:22.827601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7d735b05-7f60-46e9-8a90-951f9df27b4c None None] MFA Rules not processed for user `9a3e06823d1643d4b0c69c9bfc29b85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:22.830294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d735b05-7f60-46e9-8a90-951f9df27b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:22.864277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 856/1704] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:22 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:22.870251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.919808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 849/1705] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:22.921932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d735b05-7f60-46e9-8a90-951f9df27b4c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:22.943559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d735b05-7f60-46e9-8a90-951f9df27b4c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.009124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a1f83-81ab-408b-9ed7-16c512aa04b1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.025342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfbd86fc714c9986eca3c0cb436e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b3f99ea7e1f4fb8bd18d2ef621fb25a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.026054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.026346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.026759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.030512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:23.034068 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:23.039231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.040550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.041049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.041546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.042490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:23.047573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:23.056173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:23.071859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:23.097716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 857/1706] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:22 2022] POST /identity/v3/projects => generated 354 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:23.099976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:23.104205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:23.108088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 850/1707] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:22 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:23.109174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:23.138472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed151e-f579-4ef3-9599-bffdf6ba90cb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.258484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769592e9-aac9-4d5e-aff5-228aa3a1d1d6 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.268953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f21a1-027d-4eca-9d48-6e8f6796cf25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.269955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f21a1-027d-4eca-9d48-6e8f6796cf25 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.270584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f21a1-027d-4eca-9d48-6e8f6796cf25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.271067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f21a1-027d-4eca-9d48-6e8f6796cf25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.284564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfbd86fc714c9986eca3c0cb436e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b3f99ea7e1f4fb8bd18d2ef621fb25a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.285302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.285595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.285874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.286660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:23.286970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:23.288633 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:23.329730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 851/1708] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:23.330611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:23.438613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f21a1-027d-4eca-9d48-6e8f6796cf25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:23.441008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f21a1-027d-4eca-9d48-6e8f6796cf25 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:23.475207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 858/1709] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:23.478775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c1ade-a135-49fe-b1bf-a1f95004b1ae None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.483588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c1ade-a135-49fe-b1bf-a1f95004b1ae None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.485261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c1ade-a135-49fe-b1bf-a1f95004b1ae None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.490659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 859/1710] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:18:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:23.493964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632b1cd-cccb-41ec-9182-15b47650dd19 tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.494120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c1ade-a135-49fe-b1bf-a1f95004b1ae None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:23.503747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.504607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.505052 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.505547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.506464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:23.510330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:23.545478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 852/1711] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:23.547483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:23.554802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c1ade-a135-49fe-b1bf-a1f95004b1ae None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.565545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85dfbd86fc714c9986eca3c0cb436e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b3f99ea7e1f4fb8bd18d2ef621fb25a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.567063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.567494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.568154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] PATH_INFO: `/v3/projects/2979b1e72a48453c85f990de3144dfeb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.569530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2979b1e72a48453c85f990de3144dfeb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:23.572225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:23.577470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaaef0-9628-4e0d-af16-762aa24be138 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.602801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.603507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.604025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.604128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.604806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:23.614704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:23.651346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 853/1712] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:23.653896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:23.705739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d99e3-556a-4b0f-94fe-045d592609b4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:23.725540 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2979b1e72a48453c85f990de3144dfeb', 'request_id': 'req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:23.735455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2979b1e72a48453c85f990de3144dfeb', 'request_id': 'req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:23.760133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2979b1e72a48453c85f990de3144dfeb', 'request_id': 'req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:23.798450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] The token cache is being invalidate because project 2979b1e72a48453c85f990de3144dfeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:23.799117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:23.800977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6e18732f-a4cb-44ed-85ba-34e8eebbc9ef tempest-VolumeQuotaClassesTest-1313008940 tempest-VolumeQuotaClassesTest-1313008940-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:23.816453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 860/1713] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:23 2022] DELETE /identity/v3/projects/2979b1e72a48453c85f990de3144dfeb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:23.938410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.938758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.939053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.945145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345a916-c8cf-4480-99e3-f30526f0e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:23.945903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345a916-c8cf-4480-99e3-f30526f0e27c admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:23.946275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345a916-c8cf-4480-99e3-f30526f0e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:23.948433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345a916-c8cf-4480-99e3-f30526f0e27c admin admin] PATH_INFO: `/v3/projects/6b240043b472418881d09c11e2d360c5/users/7b13c63a176d4c95823ee7a4f143661a/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:23.975848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:23.982159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:23.986034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:23.988760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345a916-c8cf-4480-99e3-f30526f0e27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b240043b472418881d09c11e2d360c5, user_id=7b13c63a176d4c95823ee7a4f143661a, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:24.005661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345a916-c8cf-4480-99e3-f30526f0e27c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:24.014664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:24.046593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 854/1714] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:23 2022] PUT /identity/v3/projects/6b240043b472418881d09c11e2d360c5/users/7b13c63a176d4c95823ee7a4f143661a/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:24.059254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da117-2da1-4f49-9744-07705bcbe15a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:24.059529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da117-2da1-4f49-9744-07705bcbe15a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:24.059851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da117-2da1-4f49-9744-07705bcbe15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:24.151361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 861/1715] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:18:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:18:24.163335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c59da117-2da1-4f49-9744-07705bcbe15a None None] MFA Rules not processed for user `7b13c63a176d4c95823ee7a4f143661a`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:24.164608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c59da117-2da1-4f49-9744-07705bcbe15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:24.310321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 855/1716] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:24.311863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:24.313479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:24.334140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cfcf8-685a-4e03-9b4c-da4a9aca233f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:24.450559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3f746-32fe-49b1-a6db-49b43a714258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:24.452385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f746-32fe-49b1-a6db-49b43a714258 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:24.452851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f746-32fe-49b1-a6db-49b43a714258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:24.453888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f746-32fe-49b1-a6db-49b43a714258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:24.461198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3f746-32fe-49b1-a6db-49b43a714258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:24.463174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197458ad-b5e5-44c3-bdb2-4ea2db3f72dc None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:24.464144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197458ad-b5e5-44c3-bdb2-4ea2db3f72dc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:24.464556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197458ad-b5e5-44c3-bdb2-4ea2db3f72dc None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:24.466808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 856/1717] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jul 27 04:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:24.469061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3f746-32fe-49b1-a6db-49b43a714258 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:24.474323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b969738-413c-446c-b9c5-5ea6a82c5fb0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:24.474622 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b969738-413c-446c-b9c5-5ea6a82c5fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:24.474899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b969738-413c-446c-b9c5-5ea6a82c5fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:24.592340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3b969738-413c-446c-b9c5-5ea6a82c5fb0 None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:24.593576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3b969738-413c-446c-b9c5-5ea6a82c5fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:24.627903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 862/1718] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:24 2022] POST /identity/v3/projects => generated 373 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:24.632210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831dd1f-8576-45cf-8059-7cf1bc912b0c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:24.632504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831dd1f-8576-45cf-8059-7cf1bc912b0c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:24.635187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831dd1f-8576-45cf-8059-7cf1bc912b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:24.678139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5831dd1f-8576-45cf-8059-7cf1bc912b0c None None] MFA Rules not processed for user `d25dac51d65a4d5d886cceedc213fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:24.679420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5831dd1f-8576-45cf-8059-7cf1bc912b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:24.785056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 857/1719] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jul 27 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:18:24.787494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b969738-413c-446c-b9c5-5ea6a82c5fb0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:24.820847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 863/1720] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:24.822032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831dd1f-8576-45cf-8059-7cf1bc912b0c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:24.828795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b969738-413c-446c-b9c5-5ea6a82c5fb0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:24.899605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:24.974190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831dd1f-8576-45cf-8059-7cf1bc912b0c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:24.980096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:24.981515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:24.982153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:24.982153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:24.993334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:24.995037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:25.009030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 864/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:25.009906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:25.011333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.019834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2626b4b-fd3d-4f90-8df4-558da439aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:25.023962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2626b4b-fd3d-4f90-8df4-558da439aaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.025141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2626b4b-fd3d-4f90-8df4-558da439aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.028921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2626b4b-fd3d-4f90-8df4-558da439aaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.029334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2626b4b-fd3d-4f90-8df4-558da439aaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:25.030296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743688-b8e2-4537-8ac1-3a3845de851c service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:25.031352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2626b4b-fd3d-4f90-8df4-558da439aaf1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:25.047831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:25.049804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.050256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.052525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] PATH_INFO: `/v3/users/d83003c4a59c40e3b88ac7e670106ca8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.056180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83003c4a59c40e3b88ac7e670106ca8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:25.062591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:25.095374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 858/1722] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:24 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:25.096202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.100589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.100905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.146396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:25.161499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] MFA Rules not processed for user `d25dac51d65a4d5d886cceedc213fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:25.172274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.184444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83003c4a59c40e3b88ac7e670106ca8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.185822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83003c4a59c40e3b88ac7e670106ca8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.187044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83003c4a59c40e3b88ac7e670106ca8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.193641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 859/1723] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:25.198431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:25.198431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.208961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83003c4a59c40e3b88ac7e670106ca8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.218999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83003c4a59c40e3b88ac7e670106ca8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.232370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1cec-134c-42d4-b05f-4759a166ecb9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:25.241036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 865/1724] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:25 2022] DELETE /identity/v3/users/d83003c4a59c40e3b88ac7e670106ca8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:25.244260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:25.244353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:25.244353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.244353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.244593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.244661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] PATH_INFO: `/v3/users/461233b24af24e53bc0ca2fb01233ba4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.248270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461233b24af24e53bc0ca2fb01233ba4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:25.250248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:25.377089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb9924-993f-4d6f-9a82-4def02383148 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:25.389884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:25.390132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.390581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.390927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.392197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:25.393910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:25.394863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461233b24af24e53bc0ca2fb01233ba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.411077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461233b24af24e53bc0ca2fb01233ba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.415990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 866/1725] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:25.417513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:25.422849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.430725 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461233b24af24e53bc0ca2fb01233ba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.431658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461233b24af24e53bc0ca2fb01233ba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.434734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad60ae52-f991-4701-8db3-c2ebe273a018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461233b24af24e53bc0ca2fb01233ba4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:25.474910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 860/1726] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:25 2022] DELETE /identity/v3/users/461233b24af24e53bc0ca2fb01233ba4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:25.476368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.476664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.476944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.506067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:25.522817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:25.525129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.600669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f719c-970b-4984-ab00-080e2c6eafe5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:25.675385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 861/1727] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:25.676301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:25.679635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.720156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b00f7-0364-4b63-8b37-c49f1aef07b4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:25.735688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a7fb-135f-4e61-a77f-9e68c723376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:25.737893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a7fb-135f-4e61-a77f-9e68c723376b admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.739630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a7fb-135f-4e61-a77f-9e68c723376b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.739930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a7fb-135f-4e61-a77f-9e68c723376b admin admin] PATH_INFO: `/v3/projects/d96b99ef6a324c79b3892d5307499b35/users/c34a6e76847f4afe8a786e2b7cc63134/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.780543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:25.782720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.783009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.785682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.787173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a7fb-135f-4e61-a77f-9e68c723376b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96b99ef6a324c79b3892d5307499b35, user_id=c34a6e76847f4afe8a786e2b7cc63134, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:25.790695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a7fb-135f-4e61-a77f-9e68c723376b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:25.792180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.823072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 862/1728] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:25 2022] PUT /identity/v3/projects/d96b99ef6a324c79b3892d5307499b35/users/c34a6e76847f4afe8a786e2b7cc63134/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:25.826254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92893a-ec64-402f-94ca-238fdfad6c9a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:25.826541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92893a-ec64-402f-94ca-238fdfad6c9a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:25.826824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92893a-ec64-402f-94ca-238fdfad6c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:25.883437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0c92893a-ec64-402f-94ca-238fdfad6c9a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:25.889761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0c92893a-ec64-402f-94ca-238fdfad6c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:25.969307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:25.975386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:26.014753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 867/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:26.015532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:26.022884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:26.047680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:26.081724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 863/1730] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:26.082648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92893a-ec64-402f-94ca-238fdfad6c9a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:26.101748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92893a-ec64-402f-94ca-238fdfad6c9a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:26.119608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:26.120395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:26.120794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:26.121726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:26.123072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:26.124481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:26.157565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 864/1731] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:26.160957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:26.163976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:26.213834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff8c9-4ff5-42ce-aeeb-4be6954fe0ab service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:26.265336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:26.365039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:26.367901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:26.367901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:26.368120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:26.370164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1246-f81b-4799-83c8-e3a77f45f0a7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:26.378767 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203de5-51e4-406d-b844-9adf40ba0443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:26.379449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203de5-51e4-406d-b844-9adf40ba0443 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:26.379735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203de5-51e4-406d-b844-9adf40ba0443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:26.380011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203de5-51e4-406d-b844-9adf40ba0443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:26.390778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:26.392942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:26.406806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203de5-51e4-406d-b844-9adf40ba0443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:26.408923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203de5-51e4-406d-b844-9adf40ba0443 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:26.419924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 868/1732] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:26.420791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:26.434379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 865/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:26.440408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da942d4e-05d5-49a4-b3e7-a86138c68f6c service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:26.448139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:26.450051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:26.450708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:26.452347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] PATH_INFO: `/v3/projects/d96b99ef6a324c79b3892d5307499b35/users/c34a6e76847f4afe8a786e2b7cc63134/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:26.455706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96b99ef6a324c79b3892d5307499b35, user_id=c34a6e76847f4afe8a786e2b7cc63134, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:26.458879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:26.492342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 869/1734] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:26 2022] PUT /identity/v3/projects/d96b99ef6a324c79b3892d5307499b35/users/c34a6e76847f4afe8a786e2b7cc63134/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:26.493368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebe108-8928-4bfe-b6ce-b4629e0ad1f8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:26.493663 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebe108-8928-4bfe-b6ce-b4629e0ad1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:26.493999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebe108-8928-4bfe-b6ce-b4629e0ad1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:26.561891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a3ebe108-8928-4bfe-b6ce-b4629e0ad1f8 None None] MFA Rules not processed for user `c34a6e76847f4afe8a786e2b7cc63134`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:26.563681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a3ebe108-8928-4bfe-b6ce-b4629e0ad1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:26.691727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 866/1735] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:26.706467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:26.710848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:26.830758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3846-1edf-490a-95af-ae424711e2b1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:26.835769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b4f75-9efd-4e70-9abd-bb2b38a177e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:26.836597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4f75-9efd-4e70-9abd-bb2b38a177e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:26.836848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4f75-9efd-4e70-9abd-bb2b38a177e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:26.837440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4f75-9efd-4e70-9abd-bb2b38a177e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:26.863992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b4f75-9efd-4e70-9abd-bb2b38a177e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:26.865707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b4f75-9efd-4e70-9abd-bb2b38a177e0 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:26.908005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 870/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:27.032814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebe108-8928-4bfe-b6ce-b4629e0ad1f8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:27.057161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebe108-8928-4bfe-b6ce-b4629e0ad1f8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:27.076097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:27.076762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:27.077049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:27.086015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:27.096051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:27.213697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192aac8-a97d-4cdd-af8e-f18283d60177 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:27.215428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192aac8-a97d-4cdd-af8e-f18283d60177 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:27.216030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192aac8-a97d-4cdd-af8e-f18283d60177 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:27.219834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 871/1737] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:18:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:27.264568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:27.266056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:27.306273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 867/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:27.490687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:27.491290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:27.491781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:27.557139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] MFA Rules not processed for user `19e9ac125aab4b6bb623a02add505b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:27.559696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:27.619912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:27.622492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:27.637584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:27.761610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07aec6-244e-4a5b-a347-43647b782711 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:27.768564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:27.769411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:27.769845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:27.770268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] PATH_INFO: `/v3/users/223d7c7974414cc599c968a93f20833e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:27.771919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223d7c7974414cc599c968a93f20833e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:27.774616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:27.778894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 872/1739] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:27.813143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:27.814826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:27.838418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07f89-4d1d-41ce-b5f9-b64878821566 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:27.857364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a816e9-892f-48f7-bee6-58cf6f182dbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:27.858028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a816e9-892f-48f7-bee6-58cf6f182dbf service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:27.858320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a816e9-892f-48f7-bee6-58cf6f182dbf service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:27.858595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a816e9-892f-48f7-bee6-58cf6f182dbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:27.875458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a816e9-892f-48f7-bee6-58cf6f182dbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:27.877184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a816e9-892f-48f7-bee6-58cf6f182dbf service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:27.893655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223d7c7974414cc599c968a93f20833e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:27.907817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 873/1740] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:18:27.910169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223d7c7974414cc599c968a93f20833e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:27.929533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223d7c7974414cc599c968a93f20833e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:27.933142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223d7c7974414cc599c968a93f20833e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:27.934579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-de720509-ad60-45c0-8a1b-71e0cccb9ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223d7c7974414cc599c968a93f20833e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:27.981574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 868/1741] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:27 2022] DELETE /identity/v3/users/223d7c7974414cc599c968a93f20833e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:28.027974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c24bb-8039-4fc5-91ac-7f0a3748c078 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:28.028432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c24bb-8039-4fc5-91ac-7f0a3748c078 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:28.028856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c24bb-8039-4fc5-91ac-7f0a3748c078 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:28.030319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 874/1742] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 04:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:28.036936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:28.037416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:28.037842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:28.116132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] MFA Rules not processed for user `e90c842029d845bd8b4f12696354af78`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:28.117373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:28.238492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 869/1743] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:18:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:28.259364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c24bb-8039-4fc5-91ac-7f0a3748c078 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:28.268609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-060c24bb-8039-4fc5-91ac-7f0a3748c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:28.292956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c24bb-8039-4fc5-91ac-7f0a3748c078 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:28.299084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:28.300121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:28.300639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:28.301177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:28.319310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:28.321132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:28.336317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 875/1744] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:28.461572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:28.463670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:28.555253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:28.779702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1034-8080-493e-a758-f61145fa5e57 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:28.798022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:28.798405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:28.798691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:28.798965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] PATH_INFO: `/v3/projects/966593cc803343f1b6a3c548f351fbfb` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:28.813289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=966593cc803343f1b6a3c548f351fbfb)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:28.815426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:28.985006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966593cc803343f1b6a3c548f351fbfb', 'request_id': 'req-8471ff26-8b68-4327-a134-a4a1c313e19c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.008061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966593cc803343f1b6a3c548f351fbfb', 'request_id': 'req-8471ff26-8b68-4327-a134-a4a1c313e19c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.048403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966593cc803343f1b6a3c548f351fbfb', 'request_id': 'req-8471ff26-8b68-4327-a134-a4a1c313e19c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.088039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] The token cache is being invalidate because project 966593cc803343f1b6a3c548f351fbfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:29.088390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.095154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.103097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 870/1745] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:28 2022] DELETE /identity/v3/projects/966593cc803343f1b6a3c548f351fbfb => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:29.104469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:29.128019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5c50-9883-49e8-9cbe-647e109ea1ca service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:29.217695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:29.358361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:29.359034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:29.359339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:29.359622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] PATH_INFO: `/v3/users/9a3e06823d1643d4b0c69c9bfc29b85d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:29.362590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3e06823d1643d4b0c69c9bfc29b85d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:29.366163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:29.546480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3e06823d1643d4b0c69c9bfc29b85d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.547105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3e06823d1643d4b0c69c9bfc29b85d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.547861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3e06823d1643d4b0c69c9bfc29b85d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.570532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3e06823d1643d4b0c69c9bfc29b85d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.586060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:29.587552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:29.588252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f64d71f9-170c-46ac-b1cc-29666c2b2229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3e06823d1643d4b0c69c9bfc29b85d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:29.615975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ff26-8b68-4327-a134-a4a1c313e19c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:29.617152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 876/1746] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:29 2022] DELETE /identity/v3/users/9a3e06823d1643d4b0c69c9bfc29b85d => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:29.738467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:29.739032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:29.744700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:29.809928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:29.810593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:29.810874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:29.811147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] PATH_INFO: `/v3/projects/0d63531c6f7b4fe7b805c6c9cb245148` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:29.820478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d63531c6f7b4fe7b805c6c9cb245148)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:29.822454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:29.838284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] MFA Rules not processed for user `9cd6b53763844a699df2eac1918ce42d`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:29.839571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.006513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d63531c6f7b4fe7b805c6c9cb245148', 'request_id': 'req-24cadd14-f697-4b04-9a32-24dbd39b270b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.010898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:30.032274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d63531c6f7b4fe7b805c6c9cb245148', 'request_id': 'req-24cadd14-f697-4b04-9a32-24dbd39b270b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.050547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 877/1747] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:18:30.063298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d63531c6f7b4fe7b805c6c9cb245148', 'request_id': 'req-24cadd14-f697-4b04-9a32-24dbd39b270b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.076154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:30.077997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.094203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] The token cache is being invalidate because project 0d63531c6f7b4fe7b805c6c9cb245148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:30.094504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.095757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.099309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 871/1748] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:29 2022] DELETE /identity/v3/projects/0d63531c6f7b4fe7b805c6c9cb245148 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:18:30.103746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:30.108076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.169599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:30.240674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9dcac-1eae-4203-a260-2942d5939fae None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:30.299852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cadd14-f697-4b04-9a32-24dbd39b270b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:30.315891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:30.316963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:30.316963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:30.317285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] PATH_INFO: `/v3/users/85dfbd86fc714c9986eca3c0cb436e12` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:30.319033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dfbd86fc714c9986eca3c0cb436e12)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:30.321902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:30.342401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:30.343568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:30.343959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:30.344344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:30.346897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.459396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dfbd86fc714c9986eca3c0cb436e12'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.485800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dfbd86fc714c9986eca3c0cb436e12'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.513440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dfbd86fc714c9986eca3c0cb436e12'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.516707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dfbd86fc714c9986eca3c0cb436e12'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.518867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dfbd86fc714c9986eca3c0cb436e12'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.541397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:30.543451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:30.556218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 878/1749] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:30.557305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:30.559879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.577864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 872/1750] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:30 2022] DELETE /identity/v3/users/85dfbd86fc714c9986eca3c0cb436e12 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:30.578506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:30.581732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.582990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734a6d5-02be-4b77-aab2-0460dc79ae70 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:30.724122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:30.724808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:30.725113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:30.725686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] PATH_INFO: `/v3/projects/1003eb8992a347cab6d2ca10ef23b045` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:30.730947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1003eb8992a347cab6d2ca10ef23b045)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:30.733595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:30.748256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:30.775694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:30.789864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ce44c-8c18-4b93-86f6-c4d17500e642 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:30.798496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:30.799355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:30.799726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:30.800011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:30.805596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.834322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:30.836219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:30.842926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1003eb8992a347cab6d2ca10ef23b045', 'request_id': 'req-70f07931-6238-4597-ac9a-34c5f631c4a2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.853351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 873/1751] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:30.859179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1003eb8992a347cab6d2ca10ef23b045', 'request_id': 'req-70f07931-6238-4597-ac9a-34c5f631c4a2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.874805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1003eb8992a347cab6d2ca10ef23b045', 'request_id': 'req-70f07931-6238-4597-ac9a-34c5f631c4a2'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.894574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] The token cache is being invalidate because project 1003eb8992a347cab6d2ca10ef23b045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:30.894908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.897298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70f07931-6238-4597-ac9a-34c5f631c4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:30.899066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 879/1752] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:30 2022] DELETE /identity/v3/projects/1003eb8992a347cab6d2ca10ef23b045 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:30.904399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:30.920033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:30.938681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1d7c5-8a1c-40eb-9aad-3ca4c3f90807 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:31.035959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:31.036279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:31.036584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:31.108220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] MFA Rules not processed for user `1f21d428fab64ca68efa4cf114559ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:31.119821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:31.146530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:31.150092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:31.150433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:31.153062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] PATH_INFO: `/v3/users/7d8830e82bf247f1b2270eedcc2ee5ce` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:31.159657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8830e82bf247f1b2270eedcc2ee5ce)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:31.172360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:31.382972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8830e82bf247f1b2270eedcc2ee5ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.397694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 880/1753] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:31.398582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:31.400156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:31.422617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8830e82bf247f1b2270eedcc2ee5ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.436240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8830e82bf247f1b2270eedcc2ee5ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.439496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8830e82bf247f1b2270eedcc2ee5ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.439634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a61e-33f1-4cd9-936c-a32767424d26 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:31.442435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8830e82bf247f1b2270eedcc2ee5ce'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.460454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:31.461493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:31.462980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:31.465752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] PATH_INFO: `/v3/projects/8ee66cdbad2548b09a03bf11a4fc026c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:31.470901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee66cdbad2548b09a03bf11a4fc026c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:31.482769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:31.519173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 874/1754] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:30 2022] DELETE /identity/v3/users/7d8830e82bf247f1b2270eedcc2ee5ce => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:31.519173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:31.522474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:31.716841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee66cdbad2548b09a03bf11a4fc026c', 'request_id': 'req-7ebd77a5-b107-40ce-93f5-1e9702fc4661'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.745034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee66cdbad2548b09a03bf11a4fc026c', 'request_id': 'req-7ebd77a5-b107-40ce-93f5-1e9702fc4661'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.775785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee66cdbad2548b09a03bf11a4fc026c', 'request_id': 'req-7ebd77a5-b107-40ce-93f5-1e9702fc4661'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.828003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] The token cache is being invalidate because project 8ee66cdbad2548b09a03bf11a4fc026c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:31.828307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.829797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7ebd77a5-b107-40ce-93f5-1e9702fc4661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:31.843887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 881/1755] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:31 2022] DELETE /identity/v3/projects/8ee66cdbad2548b09a03bf11a4fc026c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:31.845642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f6769-4a27-4dd3-911b-f03905a62c29 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:31.847061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f6769-4a27-4dd3-911b-f03905a62c29 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:31.848101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f6769-4a27-4dd3-911b-f03905a62c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:31.882842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d655-63c2-4dce-8bb3-d1a6d9dd584f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:31.892377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d45f6769-4a27-4dd3-911b-f03905a62c29 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:31.895987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d45f6769-4a27-4dd3-911b-f03905a62c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:31.896460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:31.919897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:32.084116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 882/1756] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:32.089689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60b693-fc88-44e8-ade6-88cf24d088c7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:32.092219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60b693-fc88-44e8-ade6-88cf24d088c7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:32.092415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60b693-fc88-44e8-ade6-88cf24d088c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:32.097251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:32.097977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:32.098263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:32.098543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:32.105418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:32.141328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0e60b693-fc88-44e8-ade6-88cf24d088c7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:32.142210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0e60b693-fc88-44e8-ade6-88cf24d088c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:32.174404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 883/1757] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:32.175917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b1b49-53a2-4ddf-8f8a-22d0a898d4dc None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:32.176354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b1b49-53a2-4ddf-8f8a-22d0a898d4dc None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:32.176639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b1b49-53a2-4ddf-8f8a-22d0a898d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:32.254170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-700b1b49-53a2-4ddf-8f8a-22d0a898d4dc None None] MFA Rules not processed for user `ce7376d180c047e2b4c8a79e260367e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:32.255373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-700b1b49-53a2-4ddf-8f8a-22d0a898d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:32.265875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:32.267597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:32.294752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 875/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:32.295490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:32.317558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3f6d-dcfa-4972-a14b-bfec11bdb827 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:32.330438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:32.331222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:32.331639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:32.332030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:32.335122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:32.335122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:32.337965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:32.381007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 876/1759] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:32.382150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:32.388558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:32.428964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877a4de-f259-4c98-adc8-9e644c57afd6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:32.446265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 884/1760] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:32.449808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b1b49-53a2-4ddf-8f8a-22d0a898d4dc None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:32.455848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:32.459343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:32.460424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:32.460424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] PATH_INFO: `/v3/projects/565901834a9040d2a2418414a6af0cc6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:32.470854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=565901834a9040d2a2418414a6af0cc6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:32.476620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:32.490283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b1b49-53a2-4ddf-8f8a-22d0a898d4dc None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:32.508970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:32.511013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:32.511852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:32.512154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:32.512925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:32.514865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:32.604299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 885/1761] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:32 2022] POST /identity/v3/projects => generated 357 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:32.605884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:32.613455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:32.630462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565901834a9040d2a2418414a6af0cc6', 'request_id': 'req-6ef63556-71f6-450e-97ec-0146028aa95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:32.644674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565901834a9040d2a2418414a6af0cc6', 'request_id': 'req-6ef63556-71f6-450e-97ec-0146028aa95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:32.669274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565901834a9040d2a2418414a6af0cc6', 'request_id': 'req-6ef63556-71f6-450e-97ec-0146028aa95e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:32.690639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] The token cache is being invalidate because project 565901834a9040d2a2418414a6af0cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:32.691171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:32.692648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:32.695305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 877/1762] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:32 2022] DELETE /identity/v3/projects/565901834a9040d2a2418414a6af0cc6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:32.697614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:32.700718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:32.735902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:32.817013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d4d81-2d00-4b7a-b868-05c7a8fc6679 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:32.836214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:32.836885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:32.837169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:32.837635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:32.841243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:32.877618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:32.979441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef63556-71f6-450e-97ec-0146028aa95e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:33.096996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:33.099188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:33.140095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 886/1763] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:33.141762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:33.143800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:33.217277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafae81-9b7b-4012-9786-3eb88670491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:33.231425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafae81-9b7b-4012-9786-3eb88670491d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.231979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafae81-9b7b-4012-9786-3eb88670491d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.232498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafae81-9b7b-4012-9786-3eb88670491d admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.236329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafae81-9b7b-4012-9786-3eb88670491d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:33.249063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafae81-9b7b-4012-9786-3eb88670491d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:33.337829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 878/1764] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:32 2022] POST /identity/v3/users => generated 279 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:33.339216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98834-31a8-4845-b988-611fd5d3fce0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.339566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98834-31a8-4845-b988-611fd5d3fce0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.339856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98834-31a8-4845-b988-611fd5d3fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.405606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22825cd-c10a-4801-930a-364f5d86b834 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:33.437858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-61d98834-31a8-4845-b988-611fd5d3fce0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:33.439133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-61d98834-31a8-4845-b988-611fd5d3fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:33.440303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:33.441030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.441310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.441583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] PATH_INFO: `/v3/projects/2b3f99ea7e1f4fb8bd18d2ef621fb25a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.445675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3f99ea7e1f4fb8bd18d2ef621fb25a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:33.452209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:33.487623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 879/1765] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:33.488603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98834-31a8-4845-b988-611fd5d3fce0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:33.530205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98834-31a8-4845-b988-611fd5d3fce0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:33.545470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1ef6c-d977-47ec-83d5-431509c6de2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:33.546837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1ef6c-d977-47ec-83d5-431509c6de2b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.547473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1ef6c-d977-47ec-83d5-431509c6de2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.549668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1ef6c-d977-47ec-83d5-431509c6de2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.550763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1ef6c-d977-47ec-83d5-431509c6de2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:33.553342 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1ef6c-d977-47ec-83d5-431509c6de2b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:33.573911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 880/1766] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:33.576954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d637-d93f-468d-8bf3-d429700a4eac None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.577261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d637-d93f-468d-8bf3-d429700a4eac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.577687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d637-d93f-468d-8bf3-d429700a4eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.628457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-aea5d637-d93f-468d-8bf3-d429700a4eac None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:33.629732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-aea5d637-d93f-468d-8bf3-d429700a4eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:33.653736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3f99ea7e1f4fb8bd18d2ef621fb25a', 'request_id': 'req-fb9375f0-1078-4950-87d7-ea2be41ff37c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:33.672268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3f99ea7e1f4fb8bd18d2ef621fb25a', 'request_id': 'req-fb9375f0-1078-4950-87d7-ea2be41ff37c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:33.698494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3f99ea7e1f4fb8bd18d2ef621fb25a', 'request_id': 'req-fb9375f0-1078-4950-87d7-ea2be41ff37c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:33.743720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] The token cache is being invalidate because project 2b3f99ea7e1f4fb8bd18d2ef621fb25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:33.743720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:33.747755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:33.750667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 887/1767] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:33 2022] DELETE /identity/v3/projects/2b3f99ea7e1f4fb8bd18d2ef621fb25a => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:33.751658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:33.755626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:33.788346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 881/1768] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:33.788346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556820-7411-4d72-92c5-374b7ea56f29 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.790586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556820-7411-4d72-92c5-374b7ea56f29 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.791596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556820-7411-4d72-92c5-374b7ea56f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.841335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-16556820-7411-4d72-92c5-374b7ea56f29 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:33.843810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-16556820-7411-4d72-92c5-374b7ea56f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:33.881785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 882/1769] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:33.884438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556820-7411-4d72-92c5-374b7ea56f29 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:33.920638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:33.925090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556820-7411-4d72-92c5-374b7ea56f29 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:33.948143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb212-7729-4b09-9dc3-53a0fa0b60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:33.950643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb212-7729-4b09-9dc3-53a0fa0b60b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.950959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb212-7729-4b09-9dc3-53a0fa0b60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.951361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb212-7729-4b09-9dc3-53a0fa0b60b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.952606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb212-7729-4b09-9dc3-53a0fa0b60b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:33.953836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb212-7729-4b09-9dc3-53a0fa0b60b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:33.957722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeb212-7729-4b09-9dc3-53a0fa0b60b4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:33.985438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 883/1770] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:33.989345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ea96-43a2-4ae9-9e6e-bc3c30e8281c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:33.989636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ea96-43a2-4ae9-9e6e-bc3c30e8281c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:33.989915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ea96-43a2-4ae9-9e6e-bc3c30e8281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:33.994266 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9375f0-1078-4950-87d7-ea2be41ff37c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.020156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.020817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.021109 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.021385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.022284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.023787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:34.067155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 888/1771] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:34.069924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.079903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-95d6ea96-43a2-4ae9-9e6e-bc3c30e8281c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:34.081983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-95d6ea96-43a2-4ae9-9e6e-bc3c30e8281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:34.103631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3e3e-d360-48ba-b06f-4d865fe38bad admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.113596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 884/1772] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:34.114887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ea96-43a2-4ae9-9e6e-bc3c30e8281c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.122393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b7731-d80d-4e54-8c18-316775503d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.123040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7731-d80d-4e54-8c18-316775503d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.123359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7731-d80d-4e54-8c18-316775503d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.123634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7731-d80d-4e54-8c18-316775503d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.124338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b7731-d80d-4e54-8c18-316775503d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.134794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b7731-d80d-4e54-8c18-316775503d30 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:34.147087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ea96-43a2-4ae9-9e6e-bc3c30e8281c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.153583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.154335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.154622 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.154894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] PATH_INFO: `/v3/projects/ce85a503331e44ae9c90dcd375a4dd6b/users/57b54e6b62744f2eb1bfde105152ab2c/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.158631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:34.181614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce85a503331e44ae9c90dcd375a4dd6b, user_id=57b54e6b62744f2eb1bfde105152ab2c, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.186553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:34.219298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 885/1773] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:34 2022] PUT /identity/v3/projects/ce85a503331e44ae9c90dcd375a4dd6b/users/57b54e6b62744f2eb1bfde105152ab2c/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:34.221198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.233459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 889/1774] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:34 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:34.234805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044c7f-e403-442b-aa15-cd5eccd9dd25 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.235514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044c7f-e403-442b-aa15-cd5eccd9dd25 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.235690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044c7f-e403-442b-aa15-cd5eccd9dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.334667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f39e6a-3458-438f-8cf4-58f0fab7f395 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.340711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-89044c7f-e403-442b-aa15-cd5eccd9dd25 None None] MFA Rules not processed for user `57b54e6b62744f2eb1bfde105152ab2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:34.342182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-89044c7f-e403-442b-aa15-cd5eccd9dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:34.436352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.437878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.438267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.438967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.439880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:34.440327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.442243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:34.480003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 886/1775] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:34.482530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.505131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e8c5-cf86-447c-8654-af9b840cdca7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.527987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.530529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.531003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.531453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.532724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.539015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:34.542337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 890/1776] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:34.545609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044c7f-e403-442b-aa15-cd5eccd9dd25 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.569126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044c7f-e403-442b-aa15-cd5eccd9dd25 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.583765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.587971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.588284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.588574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.589290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.595615 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:34.628738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 887/1777] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:34 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:34.631434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.674768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b4d4-f6f2-44d8-b83a-c343849efd4b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.686913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 891/1778] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:34 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:34.688247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.697204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.698607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.710463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.710463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.710463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.715860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:34.783890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 888/1779] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:34 2022] POST /identity/v3/projects => generated 357 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:34.799291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:34.825950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad6354-51cf-4d8d-92a5-55c6fcd0ca9c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.898544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:34.919781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:34.957484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88429078-770d-4572-a9de-6b12c91fea90 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:34.976216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e54d76-f4fb-4faf-b0d8-e1e5e4a14326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.976977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54d76-f4fb-4faf-b0d8-e1e5e4a14326 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.977248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54d76-f4fb-4faf-b0d8-e1e5e4a14326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.977574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54d76-f4fb-4faf-b0d8-e1e5e4a14326 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.978217 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e54d76-f4fb-4faf-b0d8-e1e5e4a14326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.992080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:34.993342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:34.993645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:34.994729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:34.997158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:34.998076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e54d76-f4fb-4faf-b0d8-e1e5e4a14326 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.001276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.029008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 892/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:35.031072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.059714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b100c1-5dfa-4b54-bbe6-a10ab0c8ed95 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.068094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 889/1781] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:34 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:35.071829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece093-c14e-442d-9630-225420751052 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.072200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece093-c14e-442d-9630-225420751052 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.072483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece093-c14e-442d-9630-225420751052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.073282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:35.076860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.077082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.077573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.078277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:35.092471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.158274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 893/1782] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:35 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:35.159247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.197101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd280d-e396-44da-a37d-6b95407a698a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.214022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:35.215208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.215520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.215794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.216515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:35.222184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.249084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 894/1783] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:35.249084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.260379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b18ec-3b74-484a-9b33-c91ac4547366 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.266403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:35.266723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-38ece093-c14e-442d-9630-225420751052 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:35.267170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.280725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.280725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.280725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:35.280725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.281187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-38ece093-c14e-442d-9630-225420751052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:35.283305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 895/1784] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:35.284306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.295885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a59a2-1edc-4cab-9224-e84a4734b3d1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.302256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:35.304380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.304877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.305328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.308678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:35.310385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.326289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 896/1785] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:35.327639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.342885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4743b-6bed-4d37-89bc-2faae6da7545 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.350577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:35.353504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.355345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.356701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] PATH_INFO: `/v3/projects/2949adadf1fe4800a5700b02d5e15ec9/users/f16ea4b1911349ed9028c294171064df/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.389726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2949adadf1fe4800a5700b02d5e15ec9, user_id=f16ea4b1911349ed9028c294171064df, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:35.393458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.403447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 890/1786] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:18:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:35.405197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ece093-c14e-442d-9630-225420751052 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.421018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ece093-c14e-442d-9630-225420751052 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.427614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a428f-1b3a-48d0-80c6-0b6a576cf5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:35.428448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a428f-1b3a-48d0-80c6-0b6a576cf5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.428877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a428f-1b3a-48d0-80c6-0b6a576cf5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.429299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a428f-1b3a-48d0-80c6-0b6a576cf5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.430856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a428f-1b3a-48d0-80c6-0b6a576cf5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:35.434104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a428f-1b3a-48d0-80c6-0b6a576cf5e3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.467319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 897/1787] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:35 2022] PUT /identity/v3/projects/2949adadf1fe4800a5700b02d5e15ec9/users/f16ea4b1911349ed9028c294171064df/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:35.467319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.473831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 891/1788] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:35.477365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff042b-942e-496a-a896-7c1cbe0ada3b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.478000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff042b-942e-496a-a896-7c1cbe0ada3b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.478425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff042b-942e-496a-a896-7c1cbe0ada3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.524941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-65ff042b-942e-496a-a896-7c1cbe0ada3b None None] MFA Rules not processed for user `f16ea4b1911349ed9028c294171064df`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:35.527220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-65ff042b-942e-496a-a896-7c1cbe0ada3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:35.680023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfae0f-58f7-4581-bc11-59b16b35e52f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.706968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:35.708000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:35.708472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:35.708895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] PATH_INFO: `/v3/projects/22cea8cf641e4734badd88e9676cae89/users/c298f36a2dfc44b9972f579736e00b20/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:35.760175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cea8cf641e4734badd88e9676cae89, user_id=c298f36a2dfc44b9972f579736e00b20, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:35.762996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:35.816704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 892/1789] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:35.821482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff042b-942e-496a-a896-7c1cbe0ada3b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.824769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 898/1790] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:35 2022] PUT /identity/v3/projects/22cea8cf641e4734badd88e9676cae89/users/c298f36a2dfc44b9972f579736e00b20/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:35.825130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:35.834562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:35.857724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff042b-942e-496a-a896-7c1cbe0ada3b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:35.916578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:35.963140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:36.026712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:36.030350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.032218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.033167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] PATH_INFO: `/v3/projects/b4829388527c4beea96b25b3ddd2263e/users/8d809679b9884dd5b32f38a1ddb97b5b/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.061752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4829388527c4beea96b25b3ddd2263e, user_id=8d809679b9884dd5b32f38a1ddb97b5b, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:36.082294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:36.115226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc313d21-21e7-4d96-bdc9-b6daad595358 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:36.120193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 893/1791] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:35 2022] PUT /identity/v3/projects/b4829388527c4beea96b25b3ddd2263e/users/8d809679b9884dd5b32f38a1ddb97b5b/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:36.121224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:36.267439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755660f7-3f5f-49a9-af20-18ec460ceed5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:36.268735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a1f3e-0207-41b1-a798-a14ee4ad196e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:36.271401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1f3e-0207-41b1-a798-a14ee4ad196e service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.271688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1f3e-0207-41b1-a798-a14ee4ad196e service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.272665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a1f3e-0207-41b1-a798-a14ee4ad196e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.280895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:36.281346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.281635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.285437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.287757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:36.294948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:36.368894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 894/1792] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:36 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:36.371351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:36.439757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a1f3e-0207-41b1-a798-a14ee4ad196e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:36.441933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a1f3e-0207-41b1-a798-a14ee4ad196e service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:36.477597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 899/1793] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:18:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:18:36.479207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabcb58-46e6-48f7-97fb-c643edc632fa None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.479740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabcb58-46e6-48f7-97fb-c643edc632fa None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.480628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabcb58-46e6-48f7-97fb-c643edc632fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.594852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a57cec-2d60-4aae-95b7-9f0577fab4ea admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:36.612209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:36.616856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.617203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.617496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.621747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:36.623045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8eabcb58-46e6-48f7-97fb-c643edc632fa None None] MFA Rules not processed for user `8d809679b9884dd5b32f38a1ddb97b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:36.624543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8eabcb58-46e6-48f7-97fb-c643edc632fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:36.632597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:36.676405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 895/1794] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:36.677823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:36.727277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42119-5668-41e1-b7e4-4649e50fbfb3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:36.744662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:36.745463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:36.746727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.749211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.749379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.750041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:36.760383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:36.797415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 900/1795] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:36.798318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabcb58-46e6-48f7-97fb-c643edc632fa None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:36.834772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabcb58-46e6-48f7-97fb-c643edc632fa None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:36.839026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 896/1796] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:36 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:36.841802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:36.853070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:36.853803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.854057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.854344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] PATH_INFO: `/v3/projects/22cea8cf641e4734badd88e9676cae89/users/c298f36a2dfc44b9972f579736e00b20/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.864668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cea8cf641e4734badd88e9676cae89, user_id=c298f36a2dfc44b9972f579736e00b20, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:36.867301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:36.880744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedbb7f-53f2-4139-b6d9-2e5b52238e9f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:36.896451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364cf70-ed8f-4ea2-8798-976c403274ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:36.900216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364cf70-ed8f-4ea2-8798-976c403274ad admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:36.900602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364cf70-ed8f-4ea2-8798-976c403274ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:36.900892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364cf70-ed8f-4ea2-8798-976c403274ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:36.904055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364cf70-ed8f-4ea2-8798-976c403274ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:36.907332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 901/1797] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:36 2022] PUT /identity/v3/projects/22cea8cf641e4734badd88e9676cae89/users/c298f36a2dfc44b9972f579736e00b20/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:36.915256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:36.916053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364cf70-ed8f-4ea2-8798-976c403274ad admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:36.974638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:37.062391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 897/1798] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:36 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:37.069883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214ed37-93cd-4ff8-8a8f-5ce23cef2f72 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:37.070098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214ed37-93cd-4ff8-8a8f-5ce23cef2f72 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:37.070386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214ed37-93cd-4ff8-8a8f-5ce23cef2f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:37.216377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d214ed37-93cd-4ff8-8a8f-5ce23cef2f72 None None] MFA Rules not processed for user `c298f36a2dfc44b9972f579736e00b20`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:37.217648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d214ed37-93cd-4ff8-8a8f-5ce23cef2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:37.235519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70539e54-0208-4ac2-a7ce-f36ff7d49b7b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:37.314249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:37.314939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:37.315220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:37.315560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:37.316820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:37.318572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:37.333359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 902/1799] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:37.334252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:37.364957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ebbd2-c23f-4147-a0f6-c4dac73a9348 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:37.372136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:37.372717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:37.373000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:37.373332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:37.374384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:37.376995 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:37.446616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 903/1800] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:37 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:37.449529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:37.475932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a58658-3651-4bfe-83cf-f1ab9f723e4b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:37.484768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:37.487059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:37.487766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:37.488352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] PATH_INFO: `/v3/projects/1746e663c88940fcb8523e2ad27ddcd8/users/6f52de7a2d6445be903dd9fc1b28fc02/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:37.504314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 898/1801] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:37 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:37.506408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214ed37-93cd-4ff8-8a8f-5ce23cef2f72 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:37.541071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1746e663c88940fcb8523e2ad27ddcd8, user_id=6f52de7a2d6445be903dd9fc1b28fc02, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:37.548768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:37.575286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214ed37-93cd-4ff8-8a8f-5ce23cef2f72 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:37.578749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 904/1802] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:37 2022] PUT /identity/v3/projects/1746e663c88940fcb8523e2ad27ddcd8/users/6f52de7a2d6445be903dd9fc1b28fc02/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:37.580122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:37.586258 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:37.766359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:37.811954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:37.812859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:37.813683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:37.814092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd106d-081f-490d-a9f4-a0096bf818e4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:37.815231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:37.816825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:37.825341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:37.827617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:37.828469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:37.829269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:37.830815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:37.855716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 899/1803] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:37.856752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:37.883314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8e7d-a2db-4235-b4f2-86c4f7851c93 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:37.899479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:37.900739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:37.900739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:37.900739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:37.901473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:37.906244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:37.961972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 900/1804] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:37.962745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:38.009619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dcb8f-2040-4fa1-8f6d-c68b929068cc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:38.039169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21be968-cf17-4c99-b416-4ce3a7db2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:38.058156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21be968-cf17-4c99-b416-4ce3a7db2c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:38.058651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21be968-cf17-4c99-b416-4ce3a7db2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:38.060710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21be968-cf17-4c99-b416-4ce3a7db2c31 admin admin] PATH_INFO: `/v3/projects/e929619d8c6f4f13a5a9100e8340cb6d/users/436a7d45ca594e80a56c041a522aac19/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:38.093863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:38.099293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:38.122145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21be968-cf17-4c99-b416-4ce3a7db2c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e929619d8c6f4f13a5a9100e8340cb6d, user_id=436a7d45ca594e80a56c041a522aac19, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:38.130445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21be968-cf17-4c99-b416-4ce3a7db2c31 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:38.155893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 905/1805] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:37 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:38.159229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:38.185082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f2a43-f261-4cd9-901d-6a033224dc52 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:38.208086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 901/1806] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:37 2022] PUT /identity/v3/projects/e929619d8c6f4f13a5a9100e8340cb6d/users/436a7d45ca594e80a56c041a522aac19/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:38.214008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4ff6-d421-4275-96dc-fe2f1fa48676 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:38.217178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4ff6-d421-4275-96dc-fe2f1fa48676 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:38.218091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4ff6-d421-4275-96dc-fe2f1fa48676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:38.287599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-654c4ff6-d421-4275-96dc-fe2f1fa48676 None None] MFA Rules not processed for user `9cd6b53763844a699df2eac1918ce42d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:38.291230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-654c4ff6-d421-4275-96dc-fe2f1fa48676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:38.382463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:38.384088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:38.389017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:38.389381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:38.389678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] PATH_INFO: `/v3/projects/1746e663c88940fcb8523e2ad27ddcd8/users/6f52de7a2d6445be903dd9fc1b28fc02/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:38.397685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1746e663c88940fcb8523e2ad27ddcd8, user_id=6f52de7a2d6445be903dd9fc1b28fc02, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:38.409996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:38.456067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 906/1807] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:38 2022] PUT /identity/v3/projects/1746e663c88940fcb8523e2ad27ddcd8/users/6f52de7a2d6445be903dd9fc1b28fc02/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:38.458900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:38.479229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 902/1808] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:38.483972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4ff6-d421-4275-96dc-fe2f1fa48676 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:38.733302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4ff6-d421-4275-96dc-fe2f1fa48676 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:38.737429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7865eb-0d1c-4cce-b381-78e520682319 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:38.759353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c7b7a-bee3-4d68-bdad-8cd7f239407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:38.760004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7b7a-bee3-4d68-bdad-8cd7f239407a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:38.760284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7b7a-bee3-4d68-bdad-8cd7f239407a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:38.760562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7b7a-bee3-4d68-bdad-8cd7f239407a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:38.765241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c7b7a-bee3-4d68-bdad-8cd7f239407a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:38.766924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c7b7a-bee3-4d68-bdad-8cd7f239407a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:38.809692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 907/1809] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:38.816383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f47c3-0235-49bc-8822-c45e12fe3646 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:38.816714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f47c3-0235-49bc-8822-c45e12fe3646 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:38.816954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f47c3-0235-49bc-8822-c45e12fe3646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:38.908513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e836c24-6f3f-4dcc-98d2-b3db2f2e753a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:38.909167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836c24-6f3f-4dcc-98d2-b3db2f2e753a service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:38.909454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836c24-6f3f-4dcc-98d2-b3db2f2e753a service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:38.909735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836c24-6f3f-4dcc-98d2-b3db2f2e753a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:38.914776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8d4f47c3-0235-49bc-8822-c45e12fe3646 None None] MFA Rules not processed for user `6f52de7a2d6445be903dd9fc1b28fc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:38.916235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8d4f47c3-0235-49bc-8822-c45e12fe3646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:38.927771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:39.104836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e836c24-6f3f-4dcc-98d2-b3db2f2e753a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:39.108971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e836c24-6f3f-4dcc-98d2-b3db2f2e753a service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:39.134998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 903/1810] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:39.137791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426892d-9ef3-496e-ae0b-77f9bea7eccd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:39.138087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426892d-9ef3-496e-ae0b-77f9bea7eccd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:39.138397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426892d-9ef3-496e-ae0b-77f9bea7eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:39.144420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 908/1811] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:39.145353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f47c3-0235-49bc-8822-c45e12fe3646 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:39.171012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f47c3-0235-49bc-8822-c45e12fe3646 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:39.182451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:39.182667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:39.182950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:39.184650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9426892d-9ef3-496e-ae0b-77f9bea7eccd None None] MFA Rules not processed for user `e90c842029d845bd8b4f12696354af78`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:39.185585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] PATH_INFO: `/v3/projects/e929619d8c6f4f13a5a9100e8340cb6d/users/436a7d45ca594e80a56c041a522aac19/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:39.187074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9426892d-9ef3-496e-ae0b-77f9bea7eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:39.189397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e929619d8c6f4f13a5a9100e8340cb6d, user_id=436a7d45ca594e80a56c041a522aac19, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:39.192138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:39.231408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 909/1812] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:39 2022] PUT /identity/v3/projects/e929619d8c6f4f13a5a9100e8340cb6d/users/436a7d45ca594e80a56c041a522aac19/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:39.232441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:39.241775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:39.308746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:39.327356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 904/1813] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Jul 27 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:39.329468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6c84e-baee-4e67-b821-bff7b0efbe58 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:39.329759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6c84e-baee-4e67-b821-bff7b0efbe58 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:39.330030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6c84e-baee-4e67-b821-bff7b0efbe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:39.379665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f166e-f188-4096-911c-dc9e1275a49a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:39.389350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:39.389928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:39.390209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:39.390513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:39.447226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-40f6c84e-baee-4e67-b821-bff7b0efbe58 None None] MFA Rules not processed for user `436a7d45ca594e80a56c041a522aac19`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:39.456822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-40f6c84e-baee-4e67-b821-bff7b0efbe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:39.550667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:39.557401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:39.593252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 910/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:39.597951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:39.614014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:39.689884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:39.695212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 905/1815] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:39.749141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b7257-8dee-4219-ac64-a9f0bfbdad29 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:39.753733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:39.754388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:39.758273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:39.758603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:39.765901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6c84e-baee-4e67-b821-bff7b0efbe58 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:39.783093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:39.785289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:39.801102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6c84e-baee-4e67-b821-bff7b0efbe58 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:39.811798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 911/1816] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:39.820913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2de18-0ae5-43c0-8d11-690bd1a45bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:39.823941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2de18-0ae5-43c0-8d11-690bd1a45bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:39.825980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2de18-0ae5-43c0-8d11-690bd1a45bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:39.826544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2de18-0ae5-43c0-8d11-690bd1a45bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:39.849822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2de18-0ae5-43c0-8d11-690bd1a45bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:39.851539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2de18-0ae5-43c0-8d11-690bd1a45bf7 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:39.895516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 906/1817] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:40.233066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:40.260191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d02730-29c2-421a-bc9d-a0cff96c50fd service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:40.283150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340440cd-49f3-40b4-9f73-8ad532e324eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:40.283715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340440cd-49f3-40b4-9f73-8ad532e324eb service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:40.283984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340440cd-49f3-40b4-9f73-8ad532e324eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:40.284267 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340440cd-49f3-40b4-9f73-8ad532e324eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:40.306939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2022-ea68-4f26-a2ed-daf6d1fc2583 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:40.308065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2022-ea68-4f26-a2ed-daf6d1fc2583 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:40.308564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2022-ea68-4f26-a2ed-daf6d1fc2583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:40.360531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-10fd2022-ea68-4f26-a2ed-daf6d1fc2583 None None] MFA Rules not processed for user `1f21d428fab64ca68efa4cf114559ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:40.363458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-10fd2022-ea68-4f26-a2ed-daf6d1fc2583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:40.450490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340440cd-49f3-40b4-9f73-8ad532e324eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:40.451766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340440cd-49f3-40b4-9f73-8ad532e324eb service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:40.481495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 912/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:18:40.501457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 907/1819] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:42.293349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70102372-cc0d-4b26-8673-e27b477ff4db None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:42.293883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70102372-cc0d-4b26-8673-e27b477ff4db None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:42.293883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70102372-cc0d-4b26-8673-e27b477ff4db None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:42.296135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 913/1820] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 04:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:42.312717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773371c-d608-45bd-9920-25d94ed17294 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:42.313350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773371c-d608-45bd-9920-25d94ed17294 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:42.313350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773371c-d608-45bd-9920-25d94ed17294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:42.389134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e773371c-d608-45bd-9920-25d94ed17294 None None] MFA Rules not processed for user `e90c842029d845bd8b4f12696354af78`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:42.391623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e773371c-d608-45bd-9920-25d94ed17294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:42.434805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 908/1821] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:18:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:42.940901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70102372-cc0d-4b26-8673-e27b477ff4db None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:42.943151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-70102372-cc0d-4b26-8673-e27b477ff4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:42.985686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70102372-cc0d-4b26-8673-e27b477ff4db None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:43.023278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cb14-158d-47c7-8115-9a1945a4f1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:43.023949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cb14-158d-47c7-8115-9a1945a4f1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:43.024232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cb14-158d-47c7-8115-9a1945a4f1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:43.024509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cb14-158d-47c7-8115-9a1945a4f1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:43.068886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cb14-158d-47c7-8115-9a1945a4f1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:43.070399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cb14-158d-47c7-8115-9a1945a4f1c9 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:43.081984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 914/1822] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:43.188549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ea0a-6746-41b1-aaab-2b7f8fc8624b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:43.192978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ea0a-6746-41b1-aaab-2b7f8fc8624b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:43.193436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ea0a-6746-41b1-aaab-2b7f8fc8624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:43.284178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-daa1ea0a-6746-41b1-aaab-2b7f8fc8624b None None] MFA Rules not processed for user `ce7376d180c047e2b4c8a79e260367e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:43.296837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-daa1ea0a-6746-41b1-aaab-2b7f8fc8624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:43.642385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 909/1823] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:44.406202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aba20-11d5-4ffb-8357-62a1dcd5504c None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:44.406747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aba20-11d5-4ffb-8357-62a1dcd5504c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:44.406846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aba20-11d5-4ffb-8357-62a1dcd5504c None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:44.410813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 915/1824] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:18:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:44.530922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b93c2-0370-4fa6-9153-10bb29860a04 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:44.531581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b93c2-0370-4fa6-9153-10bb29860a04 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:44.532073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b93c2-0370-4fa6-9153-10bb29860a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:44.615593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4d2b93c2-0370-4fa6-9153-10bb29860a04 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:44.618908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4d2b93c2-0370-4fa6-9153-10bb29860a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:44.687739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:44.973579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 910/1825] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:18:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:45.279770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aba20-11d5-4ffb-8357-62a1dcd5504c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:45.282224 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dd8aba20-11d5-4ffb-8357-62a1dcd5504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:45.347980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aba20-11d5-4ffb-8357-62a1dcd5504c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:45.366083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91629c9b-3cec-47a9-a0d7-51987957e459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:45.373605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91629c9b-3cec-47a9-a0d7-51987957e459 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:45.373605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91629c9b-3cec-47a9-a0d7-51987957e459 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:45.373895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91629c9b-3cec-47a9-a0d7-51987957e459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:45.414899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91629c9b-3cec-47a9-a0d7-51987957e459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:45.418977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91629c9b-3cec-47a9-a0d7-51987957e459 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:45.449691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 916/1826] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:47.622415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b93c2-0370-4fa6-9153-10bb29860a04 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:47.797398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b93c2-0370-4fa6-9153-10bb29860a04 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:47.802279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:47.803794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:47.804083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:47.804403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] PATH_INFO: `/v3/users/f16ea4b1911349ed9028c294171064df` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:47.805608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16ea4b1911349ed9028c294171064df)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:47.808247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:47.889605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16ea4b1911349ed9028c294171064df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:47.903082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16ea4b1911349ed9028c294171064df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:47.914717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16ea4b1911349ed9028c294171064df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:47.918018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16ea4b1911349ed9028c294171064df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:47.918952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16ea4b1911349ed9028c294171064df'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:47.957878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 911/1827] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:47 2022] DELETE /identity/v3/users/f16ea4b1911349ed9028c294171064df => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:47.962355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:47.962877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:47.963066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:48.003419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:48.005029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:48.138490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 917/1828] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:48.181925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:48.185437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:48.316670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:48.393832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1e6c-333e-4fdd-8e90-9a2a6c01f442 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:48.413724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:48.415557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:48.416042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:48.416552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:48.433183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:48.435801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:48.459306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 912/1829] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:49.452939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:49.455137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:49.535019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d91d1-94ef-462a-9b3b-f493a1430239 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:49.582530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:49.583387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:49.583676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:49.584774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] PATH_INFO: `/v3/projects/2949adadf1fe4800a5700b02d5e15ec9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:49.587754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2949adadf1fe4800a5700b02d5e15ec9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:49.594407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:49.749502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:49.751379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2949adadf1fe4800a5700b02d5e15ec9', 'request_id': 'req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:49.761896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2949adadf1fe4800a5700b02d5e15ec9', 'request_id': 'req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:49.776816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2949adadf1fe4800a5700b02d5e15ec9', 'request_id': 'req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:49.826583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] The token cache is being invalidate because project 2949adadf1fe4800a5700b02d5e15ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:49.827137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:49.829613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:49.839345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 918/1830] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:49 2022] DELETE /identity/v3/projects/2949adadf1fe4800a5700b02d5e15ec9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:18:49.842296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:49.859089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6cbb0-04d7-453d-bbb8-cab7f685595d service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:49.949566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:49.951712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:50.148837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:50.153527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:50.155284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:50.157383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] PATH_INFO: `/v3/users/6f52de7a2d6445be903dd9fc1b28fc02` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:50.165944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f52de7a2d6445be903dd9fc1b28fc02)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:50.178314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:50.195328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867d5f-5ee5-41bd-bd9b-80545d78fbf4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:50.241566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:50.242239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:50.242516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:50.242789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] PATH_INFO: `/v3/users/8d809679b9884dd5b32f38a1ddb97b5b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:50.247308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d809679b9884dd5b32f38a1ddb97b5b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:50.290167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:50.341274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f52de7a2d6445be903dd9fc1b28fc02'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.381629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f52de7a2d6445be903dd9fc1b28fc02'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.421516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f52de7a2d6445be903dd9fc1b28fc02'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.424948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f52de7a2d6445be903dd9fc1b28fc02'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.435121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-50e9b705-181e-4110-a74d-3411a69dc03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f52de7a2d6445be903dd9fc1b28fc02'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.560713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 913/1831] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:49 2022] DELETE /identity/v3/users/6f52de7a2d6445be903dd9fc1b28fc02 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:50.562576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d809679b9884dd5b32f38a1ddb97b5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.565212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d809679b9884dd5b32f38a1ddb97b5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.566159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d809679b9884dd5b32f38a1ddb97b5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.611421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d809679b9884dd5b32f38a1ddb97b5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.649755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d809679b9884dd5b32f38a1ddb97b5b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:50.719610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 919/1832] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:49 2022] DELETE /identity/v3/users/8d809679b9884dd5b32f38a1ddb97b5b => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:50.724574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:50.724879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:50.725477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:50.816889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:50.820519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:50.924910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:50.958169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 914/1833] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:51.179854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:51.181892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:51.316555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875d062-ed8a-4291-af2f-42f061c7f712 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:51.322458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807fcb-0bab-44bb-b496-2394f9ca6fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:51.323763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807fcb-0bab-44bb-b496-2394f9ca6fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:51.324575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807fcb-0bab-44bb-b496-2394f9ca6fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:51.325142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807fcb-0bab-44bb-b496-2394f9ca6fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:51.340366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807fcb-0bab-44bb-b496-2394f9ca6fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:51.343369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807fcb-0bab-44bb-b496-2394f9ca6fd5 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:51.349369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:51.362015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 920/1834] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:18:51.947307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:51.950412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:51.964843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66fc2-16bf-4fdf-a577-ec7fefbd91bb None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:51.978503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:51.980446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:51.981480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:51.982210 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] PATH_INFO: `/v3/projects/1746e663c88940fcb8523e2ad27ddcd8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:51.983741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1746e663c88940fcb8523e2ad27ddcd8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:51.986043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:52.094188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1746e663c88940fcb8523e2ad27ddcd8', 'request_id': 'req-07f91a6e-5e50-4859-95f7-910667f1b9a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.115334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1746e663c88940fcb8523e2ad27ddcd8', 'request_id': 'req-07f91a6e-5e50-4859-95f7-910667f1b9a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.130500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1746e663c88940fcb8523e2ad27ddcd8', 'request_id': 'req-07f91a6e-5e50-4859-95f7-910667f1b9a9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.177207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] The token cache is being invalidate because project 1746e663c88940fcb8523e2ad27ddcd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:52.178313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.183953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-07f91a6e-5e50-4859-95f7-910667f1b9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.189466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 915/1835] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:51 2022] DELETE /identity/v3/projects/1746e663c88940fcb8523e2ad27ddcd8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:52.191402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:52.191926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:52.192064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:52.226901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:52.232798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:52.445118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 921/1836] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:18:52.454079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c63a-eeb2-4c5d-ba9e-e2c2740043c2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:52.455296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c63a-eeb2-4c5d-ba9e-e2c2740043c2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:52.455764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2c63a-eeb2-4c5d-ba9e-e2c2740043c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:52.488264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:52.489840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:52.525566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e64c3-0047-4f40-8ce6-cae206604083 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:52.555246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ffe2c63a-eeb2-4c5d-ba9e-e2c2740043c2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:52.560215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ffe2c63a-eeb2-4c5d-ba9e-e2c2740043c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:52.566573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:52.570229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:52.571587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:52.573082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] PATH_INFO: `/v3/projects/b4829388527c4beea96b25b3ddd2263e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:52.577660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4829388527c4beea96b25b3ddd2263e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:52.586655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:52.596781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 916/1837] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:52.598238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2c63a-eeb2-4c5d-ba9e-e2c2740043c2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:52.625659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2c63a-eeb2-4c5d-ba9e-e2c2740043c2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:52.643248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:52.644990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:52.645480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:52.646101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:52.647417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:52.647953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:52.650152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:52.669024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 917/1838] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:52.674733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:52.711187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97218945-b60c-4128-a461-8dcb0d2d79e5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:52.747293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4829388527c4beea96b25b3ddd2263e', 'request_id': 'req-cd6e4e15-64a0-4258-82a5-7d609b7b317f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.768715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4829388527c4beea96b25b3ddd2263e', 'request_id': 'req-cd6e4e15-64a0-4258-82a5-7d609b7b317f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.783437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4829388527c4beea96b25b3ddd2263e', 'request_id': 'req-cd6e4e15-64a0-4258-82a5-7d609b7b317f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.807792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] The token cache is being invalidate because project b4829388527c4beea96b25b3ddd2263e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:52.807792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.809409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:52.812433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 922/1839] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:52 2022] DELETE /identity/v3/projects/b4829388527c4beea96b25b3ddd2263e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:18:52.816061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:52.820080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:52.872677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:52.873401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:52.874882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:52.875240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:52.876609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:52.879057 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:52.936493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 918/1840] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:52 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:52.940750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:52.942883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:52.965808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4e15-64a0-4258-82a5-7d609b7b317f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.003105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:53.018966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:53.044207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6f05-a0b1-49b2-a78f-b56a92a89b84 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.052294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.055181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.055489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.055925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.058256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.061720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.082501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.083727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.084375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.084711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] PATH_INFO: `/v3/users/436a7d45ca594e80a56c041a522aac19` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.086292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436a7d45ca594e80a56c041a522aac19)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.089166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.102868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 919/1841] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:52 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:18:53.105105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:53.126463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90f109-442f-473d-9bb5-e15d49f56e86 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.133854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.134962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.136106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.136547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.137612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.140866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.154560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 920/1842] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:53.160531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:53.178280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db86ab-b670-426b-a5ac-5b2e5aead98f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.186985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436a7d45ca594e80a56c041a522aac19'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.188349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436a7d45ca594e80a56c041a522aac19'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.189685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436a7d45ca594e80a56c041a522aac19'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.190415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.191570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.192127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.192537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.193883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.195723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.207961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436a7d45ca594e80a56c041a522aac19'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.217927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa70d0bf-7880-4801-9530-5fda00e323c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436a7d45ca594e80a56c041a522aac19'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.220349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 921/1843] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:53.221649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:53.223918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:53.237850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 923/1844] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:18:52 2022] DELETE /identity/v3/users/436a7d45ca594e80a56c041a522aac19 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:53.257734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35b12b-2cc8-4620-8cf9-9ab94fb6ed5e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.336097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.336900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.337335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.337785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] PATH_INFO: `/v3/projects/9358fa5086bb4a52a408d192a9d55eaa/users/ea24e2d48732457c98a82c55c281f6d1/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.357522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9358fa5086bb4a52a408d192a9d55eaa, user_id=ea24e2d48732457c98a82c55c281f6d1, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.360804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.375756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 922/1845] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:53 2022] PUT /identity/v3/projects/9358fa5086bb4a52a408d192a9d55eaa/users/ea24e2d48732457c98a82c55c281f6d1/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:53.389738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.390137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.390527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.426352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] MFA Rules not processed for user `ea24e2d48732457c98a82c55c281f6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:53.427781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:53.515906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 924/1846] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:53.520386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:53.605011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a9fa3-7adb-4719-9d48-eadbc51f64c6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.610742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473a787-6c62-45c8-870d-8a7a90eeed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.611420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a787-6c62-45c8-870d-8a7a90eeed88 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.611730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a787-6c62-45c8-870d-8a7a90eeed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.612031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a787-6c62-45c8-870d-8a7a90eeed88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.612905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473a787-6c62-45c8-870d-8a7a90eeed88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.613173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:53.614865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:53.615559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473a787-6c62-45c8-870d-8a7a90eeed88 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.636191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77fd34-3282-4f0d-b950-486324c39193 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.643867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.644746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.645032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.646080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] PATH_INFO: `/v3/projects/e929619d8c6f4f13a5a9100e8340cb6d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.653009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e929619d8c6f4f13a5a9100e8340cb6d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.660116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.663828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 923/1847] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:53 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:53.665909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec7ad-5ace-47a7-8670-1699ddf96118 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.666204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec7ad-5ace-47a7-8670-1699ddf96118 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.666528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec7ad-5ace-47a7-8670-1699ddf96118 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.668448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 924/1848] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:53.669209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec7ad-5ace-47a7-8670-1699ddf96118 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:53.689185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:53.736938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:53.773820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e929619d8c6f4f13a5a9100e8340cb6d', 'request_id': 'req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.780474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e929619d8c6f4f13a5a9100e8340cb6d', 'request_id': 'req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.787150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec7ad-5ace-47a7-8670-1699ddf96118 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:53.790371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e929619d8c6f4f13a5a9100e8340cb6d', 'request_id': 'req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.809853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] The token cache is being invalidate because project e929619d8c6f4f13a5a9100e8340cb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:18:53.810427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.811120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47e11855-ecf2-4f2d-b93e-739f7b05e1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:18:53.829173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 925/1849] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:18:53 2022] DELETE /identity/v3/projects/e929619d8c6f4f13a5a9100e8340cb6d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:53.831022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149474-ecb1-4410-8d55-18db80c46929 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.831602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149474-ecb1-4410-8d55-18db80c46929 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.832058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149474-ecb1-4410-8d55-18db80c46929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.878632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77da2-3f87-4622-b631-26246d4cb307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:53.880028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77da2-3f87-4622-b631-26246d4cb307 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.881302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77da2-3f87-4622-b631-26246d4cb307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.881712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77da2-3f87-4622-b631-26246d4cb307 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.883036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e77da2-3f87-4622-b631-26246d4cb307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:53.884787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1f149474-ecb1-4410-8d55-18db80c46929 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:53.884988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e77da2-3f87-4622-b631-26246d4cb307 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:53.886165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1f149474-ecb1-4410-8d55-18db80c46929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:53.914348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 925/1850] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:53 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:53.916040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:53.916370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:53.916898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:53.948783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:53.950227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:53.959685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 926/1851] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:53.960749 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:53.969907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:53.997173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d74f20-e578-4e50-87e8-51c59393c820 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.004999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd5530-e636-4ef8-adca-5036bb8b3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.006507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd5530-e636-4ef8-adca-5036bb8b3e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.006935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd5530-e636-4ef8-adca-5036bb8b3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.007470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd5530-e636-4ef8-adca-5036bb8b3e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.008489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd5530-e636-4ef8-adca-5036bb8b3e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.011047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd5530-e636-4ef8-adca-5036bb8b3e94 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.024596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 927/1852] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:54.027024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b1cd-537b-47c0-a230-87ad2da9f38f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.027491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b1cd-537b-47c0-a230-87ad2da9f38f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.027985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b1cd-537b-47c0-a230-87ad2da9f38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.051904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-07f8b1cd-537b-47c0-a230-87ad2da9f38f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:54.052421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 926/1853] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:54.053196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-07f8b1cd-537b-47c0-a230-87ad2da9f38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:54.055369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f149474-ecb1-4410-8d55-18db80c46929 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.064481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 928/1854] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:54.068952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b1cd-537b-47c0-a230-87ad2da9f38f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.081334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f149474-ecb1-4410-8d55-18db80c46929 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.086968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b1cd-537b-47c0-a230-87ad2da9f38f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.093321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.094054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.094454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.094572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.094738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.095018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] PATH_INFO: `/v3/projects/af60206e00ab4edcb28d5806210d95df/users/d226ebfaa7cc45f78bfcd1ddf5e5ed8c/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.095131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.095534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.096775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:18:54.096775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.098530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.126976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 929/1855] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:18:54.128047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.131074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:54.149241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=af60206e00ab4edcb28d5806210d95df, user_id=d226ebfaa7cc45f78bfcd1ddf5e5ed8c, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.153353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef38c1-7b5f-4d1b-a9ca-e2fd27f2de7f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.156321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.161932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.163239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.163660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.164035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.187452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.190591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.202420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 927/1856] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:54 2022] PUT /identity/v3/projects/af60206e00ab4edcb28d5806210d95df/users/d226ebfaa7cc45f78bfcd1ddf5e5ed8c/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:54.204472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.219947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 930/1857] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:54.221511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.245716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d8f0-6c83-44f2-a165-9051e1c2b7b5 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.402917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592a679-3b56-40df-8ef9-95bb621143ad admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.424000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.425290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.425590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.425842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.427831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.429797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.465564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.466196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.467211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.467211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.468261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.470122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.471575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:54.513046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 931/1858] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:54.515022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.535899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 928/1859] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:54 2022] POST /identity/v3/projects => generated 373 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:54.540580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.544804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6e137-29bf-4b01-b027-a28965174a19 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.605754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:54.733942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7eba7-aba0-465d-b113-86ec33e96a71 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.739358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92388b27-5a11-4417-b457-89e35f6088ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.740400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92388b27-5a11-4417-b457-89e35f6088ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.740853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92388b27-5a11-4417-b457-89e35f6088ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.741879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92388b27-5a11-4417-b457-89e35f6088ac admin admin] PATH_INFO: `/v3/projects/af60206e00ab4edcb28d5806210d95df/users/d226ebfaa7cc45f78bfcd1ddf5e5ed8c/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.747798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92388b27-5a11-4417-b457-89e35f6088ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=af60206e00ab4edcb28d5806210d95df, user_id=d226ebfaa7cc45f78bfcd1ddf5e5ed8c, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.752683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.753366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.753650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.753972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.754662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.756712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.758322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92388b27-5a11-4417-b457-89e35f6088ac admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.788563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 929/1860] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:54 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:18:54.792166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.804098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 932/1861] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:54 2022] PUT /identity/v3/projects/af60206e00ab4edcb28d5806210d95df/users/d226ebfaa7cc45f78bfcd1ddf5e5ed8c/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:54.804324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea935c-bb33-47ba-bba5-853f3123422b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.816768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.817140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.817321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.864302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] MFA Rules not processed for user `d226ebfaa7cc45f78bfcd1ddf5e5ed8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:54.865626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:54.909403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.910447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.910734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.911017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.911763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.914636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.931098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 930/1862] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:18:54.936043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:54.949412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd615-ad27-49e0-a4ce-b1a9688c9fd6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:54.966137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:54.966936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:54.967375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:54.967760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:54.968676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:54.970403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:54.988191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 931/1863] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:18:54.989403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:55.003574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 933/1864] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:55.004591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f178-2b30-4054-9042-de9730b898d7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:55.011533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6f67-50e9-4ef2-ac2b-b0b4382e5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:55.012306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6f67-50e9-4ef2-ac2b-b0b4382e5cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:55.012537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6f67-50e9-4ef2-ac2b-b0b4382e5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:55.012858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6f67-50e9-4ef2-ac2b-b0b4382e5cb0 admin admin] PATH_INFO: `/v3/projects/df10f90027b84ab4aa181446031e904f/users/c368c7af0b2645d28aaa637444bbd152/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:55.013240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:55.019991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:55.036226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6f67-50e9-4ef2-ac2b-b0b4382e5cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df10f90027b84ab4aa181446031e904f, user_id=c368c7af0b2645d28aaa637444bbd152, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:55.039695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6f67-50e9-4ef2-ac2b-b0b4382e5cb0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:55.059682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 932/1865] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:54 2022] PUT /identity/v3/projects/df10f90027b84ab4aa181446031e904f/users/c368c7af0b2645d28aaa637444bbd152/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:55.065111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:55.066690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:55.067794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:55.094658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:55.095363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:55.111343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb119b8-536d-465c-ba08-52b2e48f0657 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:55.163377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:55.175321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 933/1866] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:55.188489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:55.190660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:55.195347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1570e-fe20-443e-a88b-548eb58288d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:55.196118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1570e-fe20-443e-a88b-548eb58288d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:55.197276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1570e-fe20-443e-a88b-548eb58288d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:55.197394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1570e-fe20-443e-a88b-548eb58288d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:55.198473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:55.202369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d0a1570e-fe20-443e-a88b-548eb58288d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:55.301034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3771446-568f-4413-9e09-972f75ef8626 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:55.302415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1570e-fe20-443e-a88b-548eb58288d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:55.304003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1570e-fe20-443e-a88b-548eb58288d5 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:55.309645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:55.311344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:55.312229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:55.312708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:55.315636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 934/1867] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:55.325210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:55.326732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:55.359726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 934/1868] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:18:56.556589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:56.557223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:56.557550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:56.625370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] MFA Rules not processed for user `c368c7af0b2645d28aaa637444bbd152`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:56.626643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:56.786860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 935/1869] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:56.792298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:56.809198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107866a-f348-4568-bd63-7a3fda99c5a1 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:56.826279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:56.827303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:56.827743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:56.828178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:56.829008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:56.832339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:56.882637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:56.884233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:56.887807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 935/1870] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:18:56 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:18:56.891667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:56.911547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd1e0b-5a0a-4731-a023-d7b0fbe8c75d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:57.043881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:57.052254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:57.052792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:57.054422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:57.095026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925cc7d-1ac8-462a-9ad7-9c6c6197cdd7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:57.111423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:57.112107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:57.112413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:57.112679 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:57.113364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:57.115386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:57.133983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:57.178097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 936/1871] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:18:56 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:18:57.181254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:57.213334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b407ee-9ab6-4f37-b5ff-f2ed32365adb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:57.218541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:57.220445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:57.222045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:57.222856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:57.223392 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:57.223768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:57.224692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:57.226899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:57.234781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 936/1872] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:57.247005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 937/1873] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:57.248271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:57.261631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c144-022d-49aa-8e7c-711d84b0d23f service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:57.266116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:57.266800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:57.267086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:57.267392 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] PATH_INFO: `/v3/projects/1a6c2b9e2a1e401a99ce62d702c59e62/users/3d6cbc3b72d54690839061e7d6eab9a3/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:57.301313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c2b9e2a1e401a99ce62d702c59e62, user_id=3d6cbc3b72d54690839061e7d6eab9a3, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:57.309112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:57.329511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 937/1874] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:57 2022] PUT /identity/v3/projects/1a6c2b9e2a1e401a99ce62d702c59e62/users/3d6cbc3b72d54690839061e7d6eab9a3/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:57.330126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:57.361489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4de8e-cdb6-42f1-97fe-bd308f439274 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:57.499151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f90590-e1b5-4589-bbc6-dade260a5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:57.500132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90590-e1b5-4589-bbc6-dade260a5332 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:57.500255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90590-e1b5-4589-bbc6-dade260a5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:57.500668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90590-e1b5-4589-bbc6-dade260a5332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:57.501457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f90590-e1b5-4589-bbc6-dade260a5332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:57.503190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f90590-e1b5-4589-bbc6-dade260a5332 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:57.520102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:57.528364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 938/1875] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:18:57.533339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:57.549976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c59b-b1ee-4a91-b3cd-52974b3067f7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:57.568291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1b5ad-6557-422e-a2b6-a14163b438bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:57.570470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1b5ad-6557-422e-a2b6-a14163b438bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:57.570760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1b5ad-6557-422e-a2b6-a14163b438bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:57.571089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1b5ad-6557-422e-a2b6-a14163b438bb admin admin] PATH_INFO: `/v3/projects/1a6c2b9e2a1e401a99ce62d702c59e62/users/3d6cbc3b72d54690839061e7d6eab9a3/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:57.579115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1b5ad-6557-422e-a2b6-a14163b438bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c2b9e2a1e401a99ce62d702c59e62, user_id=3d6cbc3b72d54690839061e7d6eab9a3, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:57.587668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1b5ad-6557-422e-a2b6-a14163b438bb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:57.618131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 938/1876] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:18:57 2022] PUT /identity/v3/projects/1a6c2b9e2a1e401a99ce62d702c59e62/users/3d6cbc3b72d54690839061e7d6eab9a3/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:18:58.496862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127562-ab2b-4902-a904-aa350c4b42ed None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:58.497328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127562-ab2b-4902-a904-aa350c4b42ed None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:58.505035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127562-ab2b-4902-a904-aa350c4b42ed None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:58.505035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 939/1877] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:18:58.531830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a543-af0d-48d1-a033-198484d68ac4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:58.532188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a543-af0d-48d1-a033-198484d68ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:58.532651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a543-af0d-48d1-a033-198484d68ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:58.563297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d355a543-af0d-48d1-a033-198484d68ac4 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:58.564679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d355a543-af0d-48d1-a033-198484d68ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:58.671219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 939/1878] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:58.737595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127562-ab2b-4902-a904-aa350c4b42ed None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:58.750266 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-30127562-ab2b-4902-a904-aa350c4b42ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:58.792951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127562-ab2b-4902-a904-aa350c4b42ed None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:58.806294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fd151-3324-4b43-97ec-fc38ec3de907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:58.807156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd151-3324-4b43-97ec-fc38ec3de907 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:58.807518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd151-3324-4b43-97ec-fc38ec3de907 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:58.807852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd151-3324-4b43-97ec-fc38ec3de907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:58.824396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fd151-3324-4b43-97ec-fc38ec3de907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:58.826037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fd151-3324-4b43-97ec-fc38ec3de907 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:58.872008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ec62-3d49-44e4-9d18-ab13fd489f63 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:58.873144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ec62-3d49-44e4-9d18-ab13fd489f63 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:58.873268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 940/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:18:58.874317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ec62-3d49-44e4-9d18-ab13fd489f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:58.934275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6d76ec62-3d49-44e4-9d18-ab13fd489f63 None None] MFA Rules not processed for user `3d6cbc3b72d54690839061e7d6eab9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:58.936808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d76ec62-3d49-44e4-9d18-ab13fd489f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:59.180588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 940/1880] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:59.185206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:59.185716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:59.186471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:59.219949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] MFA Rules not processed for user `c368c7af0b2645d28aaa637444bbd152`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:18:59.222720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:18:59.340006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 941/1881] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:18:59.353457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76ec62-3d49-44e4-9d18-ab13fd489f63 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:18:59.363896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:18:59.372959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76ec62-3d49-44e4-9d18-ab13fd489f63 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:18:59.384648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550be38c-8bea-410a-83a7-efb86a776f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:18:59.387443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550be38c-8bea-410a-83a7-efb86a776f32 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:18:59.388577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550be38c-8bea-410a-83a7-efb86a776f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:18:59.392317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550be38c-8bea-410a-83a7-efb86a776f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:18:59.422601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550be38c-8bea-410a-83a7-efb86a776f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:18:59.425799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550be38c-8bea-410a-83a7-efb86a776f32 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:18:59.452702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 941/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:00.879299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:00.880748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:01.040395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffb5df-ee76-476e-9f98-f357b823c92b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:01.046325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:01.047294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:01.047696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:01.048035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] PATH_INFO: `/v3/users/57b54e6b62744f2eb1bfde105152ab2c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:01.049319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b54e6b62744f2eb1bfde105152ab2c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:01.051619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:01.158251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b54e6b62744f2eb1bfde105152ab2c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.159172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b54e6b62744f2eb1bfde105152ab2c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.159932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b54e6b62744f2eb1bfde105152ab2c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.186660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b54e6b62744f2eb1bfde105152ab2c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.207969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b54e6b62744f2eb1bfde105152ab2c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.230222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 942/1883] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:00 2022] DELETE /identity/v3/users/57b54e6b62744f2eb1bfde105152ab2c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:01.235024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:01.236013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:01.238135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:01.266784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:01.268467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:01.344941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 942/1884] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:01.355439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:01.356846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:01.372849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:01.427954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eecd4-7162-4f92-bcdc-1bda17871ff6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:01.432199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:01.432812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:01.433122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:01.433416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:01.442891 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:01.444385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:01.455122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 943/1885] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:01.751452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:01.752879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:01.775087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34cab4-38ce-4360-8b1c-63bca4d4a88c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:01.782844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:01.783568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:01.783900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:01.784173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] PATH_INFO: `/v3/projects/ce85a503331e44ae9c90dcd375a4dd6b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:01.785395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce85a503331e44ae9c90dcd375a4dd6b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:01.787335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:01.837761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce85a503331e44ae9c90dcd375a4dd6b', 'request_id': 'req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.845073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce85a503331e44ae9c90dcd375a4dd6b', 'request_id': 'req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.850770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce85a503331e44ae9c90dcd375a4dd6b', 'request_id': 'req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.863025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] The token cache is being invalidate because project ce85a503331e44ae9c90dcd375a4dd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:01.863354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.864018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:01.865556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 943/1886] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:01 2022] DELETE /identity/v3/projects/ce85a503331e44ae9c90dcd375a4dd6b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:01.870184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:01.880429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5c30-db46-4b70-a2a8-07c18ad87a69 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:01.937638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:01.938283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:01.938562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:01.938839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] PATH_INFO: `/v3/users/c298f36a2dfc44b9972f579736e00b20` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:01.940097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c298f36a2dfc44b9972f579736e00b20)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:01.942070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:02.002545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c298f36a2dfc44b9972f579736e00b20'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.003386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c298f36a2dfc44b9972f579736e00b20'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.004008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c298f36a2dfc44b9972f579736e00b20'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.016675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c298f36a2dfc44b9972f579736e00b20'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.028433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-43464f39-f8e8-46cc-b21b-2c3f3ac9e8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c298f36a2dfc44b9972f579736e00b20'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.046038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 944/1887] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:01 2022] DELETE /identity/v3/users/c298f36a2dfc44b9972f579736e00b20 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:02.156517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:02.158116 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:02.193916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa012eb-ab12-4a5b-9480-bc11a294ce6d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:02.313602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:02.315777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:02.316514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:02.316997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] PATH_INFO: `/v3/users/ea24e2d48732457c98a82c55c281f6d1` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:02.318492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea24e2d48732457c98a82c55c281f6d1)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:02.325710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:02.360130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:02.417129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea24e2d48732457c98a82c55c281f6d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.443377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea24e2d48732457c98a82c55c281f6d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.474440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea24e2d48732457c98a82c55c281f6d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.477357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea24e2d48732457c98a82c55c281f6d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.485936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea24e2d48732457c98a82c55c281f6d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.559523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 944/1888] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:02 2022] DELETE /identity/v3/users/ea24e2d48732457c98a82c55c281f6d1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:02.564782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:02.565162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:02.565604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:02.633783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:02.639302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:02.710120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:02.765812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:02.766974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:02.768307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 945/1889] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:02.783910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:02.785840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:02.790072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1fef3-6e60-4967-987d-c7e48a610225 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:02.810053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:02.810728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:02.811012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:02.811660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] PATH_INFO: `/v3/projects/22cea8cf641e4734badd88e9676cae89` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:02.816915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cea8cf641e4734badd88e9676cae89)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:02.820910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:02.922007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c38d2-f2c0-4f97-b3bb-1a700a9cb523 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:02.944557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cea8cf641e4734badd88e9676cae89', 'request_id': 'req-62124528-7ec0-4a44-803e-f78bae1714b3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.968282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cea8cf641e4734badd88e9676cae89', 'request_id': 'req-62124528-7ec0-4a44-803e-f78bae1714b3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.977778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cea8cf641e4734badd88e9676cae89', 'request_id': 'req-62124528-7ec0-4a44-803e-f78bae1714b3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.996613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] The token cache is being invalidate because project 22cea8cf641e4734badd88e9676cae89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:02.996909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:02.998087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-62124528-7ec0-4a44-803e-f78bae1714b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:03.003380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 945/1890] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:02 2022] DELETE /identity/v3/projects/22cea8cf641e4734badd88e9676cae89 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:03.005457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb61d4-0ec5-41e3-9f88-a7d916e97a45 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.005802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb61d4-0ec5-41e3-9f88-a7d916e97a45 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.006078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb61d4-0ec5-41e3-9f88-a7d916e97a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.049641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:03.050438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.050730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.051010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.056400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:03.059508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-17bb61d4-0ec5-41e3-9f88-a7d916e97a45 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:03.065358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-17bb61d4-0ec5-41e3-9f88-a7d916e97a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:03.160135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 946/1891] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:03.168716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a87d-7156-4adb-951e-3527e84008ee None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.169608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a87d-7156-4adb-951e-3527e84008ee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.169608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a87d-7156-4adb-951e-3527e84008ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.180365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:03.182284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:03.195677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 946/1892] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:03.212702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a279a87d-7156-4adb-951e-3527e84008ee None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:03.215814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a279a87d-7156-4adb-951e-3527e84008ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:03.226798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 947/1893] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:03.231246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:03.242700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0352b5-6653-403a-b947-a007c022899b service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:03.248665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:03.249244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.249822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.249822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.250712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:03.250841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:03.252513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:03.271696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 947/1894] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:03.276821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a87d-7156-4adb-951e-3527e84008ee None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:03.286767 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a87d-7156-4adb-951e-3527e84008ee None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:03.293365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:03.294239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.294735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.295187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.296048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:03.298401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:03.311095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:03.341765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:03.346928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 948/1895] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:03 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:03.356593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180c53-9fe5-484e-8855-f7ac0d9b00c7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:03.403249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:03.447866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:03.448507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.449180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.449357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.450021 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:03.451994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:03.495629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:03.496578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 948/1896] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:03 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:03.516050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c19e2-8200-4957-a17e-374bc4f5db80 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:03.524613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:03.526329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.526583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.527389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.528888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:03.532273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:03.552077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 949/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:03.553578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:03.565468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f388e2-4166-4081-9ce5-f527a8525ce6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:03.573956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ee2c-50fe-410d-a836-42d9b9b43872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:03.575109 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ee2c-50fe-410d-a836-42d9b9b43872 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.575559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ee2c-50fe-410d-a836-42d9b9b43872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.576409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ee2c-50fe-410d-a836-42d9b9b43872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.577395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ee2c-50fe-410d-a836-42d9b9b43872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:03.585040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ee2c-50fe-410d-a836-42d9b9b43872 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:03.603574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 949/1898] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:03.607613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:03.620982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cefc24-8684-4473-bfd0-1e3fab069cc4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:03.627702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:03.628391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.628672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.629008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] PATH_INFO: `/v3/projects/458c31afc263497793c8856062f4ba52/users/14e8aa31356249b898226bba59fee42a/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.649776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=458c31afc263497793c8856062f4ba52, user_id=14e8aa31356249b898226bba59fee42a, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:03.653467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:03.670997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 950/1899] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:03 2022] PUT /identity/v3/projects/458c31afc263497793c8856062f4ba52/users/14e8aa31356249b898226bba59fee42a/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:03.684261 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6bd5b-ee4e-4bd6-a93b-c05cb306683a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:03.684751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6bd5b-ee4e-4bd6-a93b-c05cb306683a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:03.685139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6bd5b-ee4e-4bd6-a93b-c05cb306683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:03.746272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b4c6bd5b-ee4e-4bd6-a93b-c05cb306683a None None] MFA Rules not processed for user `14e8aa31356249b898226bba59fee42a`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:03.750785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b4c6bd5b-ee4e-4bd6-a93b-c05cb306683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:03.802890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:03.805058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:03.937836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 950/1900] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:03.942680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6bd5b-ee4e-4bd6-a93b-c05cb306683a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.028111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212f5c-18fa-4e30-8224-b19bba9dcb8d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.049783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.050395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.050690 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.051349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] PATH_INFO: `/v3/projects/9358fa5086bb4a52a408d192a9d55eaa` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.054495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9358fa5086bb4a52a408d192a9d55eaa)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.058717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.090346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6bd5b-ee4e-4bd6-a93b-c05cb306683a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.105072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.107069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.107406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.109856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.110494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.112638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.133054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9358fa5086bb4a52a408d192a9d55eaa', 'request_id': 'req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.150819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9358fa5086bb4a52a408d192a9d55eaa', 'request_id': 'req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.162148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9358fa5086bb4a52a408d192a9d55eaa', 'request_id': 'req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.192669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] The token cache is being invalidate because project 9358fa5086bb4a52a408d192a9d55eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:04.192941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.193605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.195434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 951/1901] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:03 2022] DELETE /identity/v3/projects/9358fa5086bb4a52a408d192a9d55eaa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:04.202130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 951/1902] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:03 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:04.205699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.207438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:04.213137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.215488 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:04.274186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:04.287888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:04.320216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff854-226d-4325-a0a2-d57f3e3e6fd9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.327688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.329632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.329929 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.330205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] PATH_INFO: `/v3/users/d226ebfaa7cc45f78bfcd1ddf5e5ed8c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.333313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d226ebfaa7cc45f78bfcd1ddf5e5ed8c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.335531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.335649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02deba-56be-44db-8a4e-e5df89ac4565 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.341035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.341745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.342195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.342504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.343713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.345766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.382000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 952/1903] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:04 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:04.382965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.397513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2d6c-3de4-49de-ba79-e7687a150ce8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.404625 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.405062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.405436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.405934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.406717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.408550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.411026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd226ebfaa7cc45f78bfcd1ddf5e5ed8c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.427931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 953/1904] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:04.428919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.430165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd226ebfaa7cc45f78bfcd1ddf5e5ed8c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.449153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd226ebfaa7cc45f78bfcd1ddf5e5ed8c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.449773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd7c8-8382-4f12-a0ed-d515cf470267 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.450044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd226ebfaa7cc45f78bfcd1ddf5e5ed8c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.451095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd226ebfaa7cc45f78bfcd1ddf5e5ed8c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.460177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72e927-86d5-4481-bfc8-24cd4e03be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.461056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e927-86d5-4481-bfc8-24cd4e03be96 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.461744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e927-86d5-4481-bfc8-24cd4e03be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.462200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e927-86d5-4481-bfc8-24cd4e03be96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.463768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72e927-86d5-4481-bfc8-24cd4e03be96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.466249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72e927-86d5-4481-bfc8-24cd4e03be96 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.483247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 952/1905] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:04 2022] DELETE /identity/v3/users/d226ebfaa7cc45f78bfcd1ddf5e5ed8c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:04.490907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 954/1906] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:04.492469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.496352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:04.593187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2092-4f0c-45bc-ad01-57ea49477017 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.599694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.600606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.601075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.601363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] PATH_INFO: `/v3/projects/48a4857b6d9e4d0eb3447dab2de60330/users/342c660d1f8a4e708b6d359129db0b02/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.625408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a4857b6d9e4d0eb3447dab2de60330, user_id=342c660d1f8a4e708b6d359129db0b02, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.629051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.659471 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 953/1907] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:04 2022] PUT /identity/v3/projects/48a4857b6d9e4d0eb3447dab2de60330/users/342c660d1f8a4e708b6d359129db0b02/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:04.662016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4d3f-a591-481f-8cd7-291ce915d3a0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.662520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4d3f-a591-481f-8cd7-291ce915d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.662964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4d3f-a591-481f-8cd7-291ce915d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.708137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.710139 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:04.711432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-96dd4d3f-a591-481f-8cd7-291ce915d3a0 None None] MFA Rules not processed for user `342c660d1f8a4e708b6d359129db0b02`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:04.713386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-96dd4d3f-a591-481f-8cd7-291ce915d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:04.809212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 955/1908] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:04.810534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd4d3f-a591-481f-8cd7-291ce915d3a0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.818279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:04.848758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e60d0-caf3-4b97-9169-d1e32b54ead7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.856555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.857511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.857903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.858816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] PATH_INFO: `/v3/users/7b13c63a176d4c95823ee7a4f143661a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.860619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b13c63a176d4c95823ee7a4f143661a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.862794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.907694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd4d3f-a591-481f-8cd7-291ce915d3a0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:04.917090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:04.917746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:04.918027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:04.918303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:04.919318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:04.922039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:04.959763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 956/1909] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:04 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:04.961208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b13c63a176d4c95823ee7a4f143661a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:04.961929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:04.969270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:04.996055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b13c63a176d4c95823ee7a4f143661a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.011013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b13c63a176d4c95823ee7a4f143661a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.012413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b13c63a176d4c95823ee7a4f143661a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.013359 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b13c63a176d4c95823ee7a4f143661a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.050882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 954/1910] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:04 2022] DELETE /identity/v3/users/7b13c63a176d4c95823ee7a4f143661a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:05.058902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.059533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:05.067521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019a1c9-51a1-41dc-b644-5897e28ae99f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.185022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ad31-048d-47ba-a449-42e6b5db3a13 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.191036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.192058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.192569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.193091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] PATH_INFO: `/v3/projects/af60206e00ab4edcb28d5806210d95df` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.194570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af60206e00ab4edcb28d5806210d95df)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.196703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.209835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe299c0-4402-407c-86a2-2ac3f5c5309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.210835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe299c0-4402-407c-86a2-2ac3f5c5309a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.211361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe299c0-4402-407c-86a2-2ac3f5c5309a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.211872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe299c0-4402-407c-86a2-2ac3f5c5309a admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.216039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe299c0-4402-407c-86a2-2ac3f5c5309a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.218290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe299c0-4402-407c-86a2-2ac3f5c5309a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.282614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 957/1911] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:04 2022] POST /identity/v3/users => generated 300 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:05.284063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200212-4f35-4d35-9750-0688071a0bad None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.284356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200212-4f35-4d35-9750-0688071a0bad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.284631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200212-4f35-4d35-9750-0688071a0bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.286899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af60206e00ab4edcb28d5806210d95df', 'request_id': 'req-13ab10e0-97a9-4262-81c5-a2278c8d6697'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.298800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af60206e00ab4edcb28d5806210d95df', 'request_id': 'req-13ab10e0-97a9-4262-81c5-a2278c8d6697'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.307896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af60206e00ab4edcb28d5806210d95df', 'request_id': 'req-13ab10e0-97a9-4262-81c5-a2278c8d6697'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.310343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:05.326489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] The token cache is being invalidate because project af60206e00ab4edcb28d5806210d95df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:05.327058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.327871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:05.329247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ef200212-4f35-4d35-9750-0688071a0bad None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:05.329862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 955/1912] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:05 2022] DELETE /identity/v3/projects/af60206e00ab4edcb28d5806210d95df => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:05.330619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ef200212-4f35-4d35-9750-0688071a0bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:05.330727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.333526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:05.422301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 958/1913] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:05.423443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.423729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.423998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.450209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:05.451626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:05.452438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab10e0-97a9-4262-81c5-a2278c8d6697 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.457873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa47fc-a2eb-4dba-a674-621b512f0cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.459029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa47fc-a2eb-4dba-a674-621b512f0cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.459304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa47fc-a2eb-4dba-a674-621b512f0cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.459587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa47fc-a2eb-4dba-a674-621b512f0cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.460877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa47fc-a2eb-4dba-a674-621b512f0cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.461011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 959/1914] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:05.461645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.462255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa47fc-a2eb-4dba-a674-621b512f0cc0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.469601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:05.480599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 956/1915] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:05.482097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1e8b-6709-4cf5-9382-fcaee32c94b4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.482391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1e8b-6709-4cf5-9382-fcaee32c94b4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.482664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1e8b-6709-4cf5-9382-fcaee32c94b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.504109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2bce1e8b-6709-4cf5-9382-fcaee32c94b4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:05.505435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2bce1e8b-6709-4cf5-9382-fcaee32c94b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:05.514762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 957/1916] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:05.515665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1e8b-6709-4cf5-9382-fcaee32c94b4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.532537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:05.541313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1e8b-6709-4cf5-9382-fcaee32c94b4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.550962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.552044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.552976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.553330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] PATH_INFO: `/v3/projects/d9f8990f5a0d4381a3e4b4c2d454d0c8/users/09941bb759fa48c0932a9a756fe9c42b/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.564043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebf1b5-923f-48bb-9a35-d9dc5a409629 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.567890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.568595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.568948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.569290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.577050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f8990f5a0d4381a3e4b4c2d454d0c8, user_id=09941bb759fa48c0932a9a756fe9c42b, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.581347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.586323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.588468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.609407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 958/1917] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:05 2022] PUT /identity/v3/projects/d9f8990f5a0d4381a3e4b4c2d454d0c8/users/09941bb759fa48c0932a9a756fe9c42b/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:05.611289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.615551 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 960/1918] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:05.617306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.635881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff204b4-9c4d-4b9f-86e7-066ec518ab43 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.739438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.740900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.741314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.741876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.743256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.746546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.763862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 961/1919] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:05.767227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab452416-5e68-49b6-9b9a-d813cf2d0502 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.768723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.774324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.774962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.775906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.776635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.776912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:05.777208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.778866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.786048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1c0f-2714-46d8-ab7f-1800544b34f7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.794148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43ca1f-5186-44ac-85cd-c7ef6c2996e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.795101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43ca1f-5186-44ac-85cd-c7ef6c2996e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.795351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 959/1920] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:05.795804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43ca1f-5186-44ac-85cd-c7ef6c2996e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.796259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43ca1f-5186-44ac-85cd-c7ef6c2996e6 admin admin] PATH_INFO: `/v3/projects/d9f8990f5a0d4381a3e4b4c2d454d0c8/users/09941bb759fa48c0932a9a756fe9c42b/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.798762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43ca1f-5186-44ac-85cd-c7ef6c2996e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f8990f5a0d4381a3e4b4c2d454d0c8, user_id=09941bb759fa48c0932a9a756fe9c42b, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.799392 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:05.802882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43ca1f-5186-44ac-85cd-c7ef6c2996e6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.812866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69194789-c24d-4c10-a313-67ace49346b3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:05.832664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 962/1921] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:05 2022] PUT /identity/v3/projects/d9f8990f5a0d4381a3e4b4c2d454d0c8/users/09941bb759fa48c0932a9a756fe9c42b/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:05.834694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.835489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.835912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.881168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:05.881600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] MFA Rules not processed for user `09941bb759fa48c0932a9a756fe9c42b`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:05.886723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:05.890811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:05.890811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:05.891113 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:05.891560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:05.892260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:05.895089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:05.933947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 960/1922] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:05 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:05.937621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.006782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 963/1923] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:06.016257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.018281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:06.101742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:06.115403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede95e4-2d4d-4bd5-8c3b-acbf6f496ba8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.136809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2aa67-061a-40b2-b5b6-d6c1efe86315 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.148482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.149467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.149467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.149670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.151125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.153852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.190565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 961/1924] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:05 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:06.194380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.218348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27210449-5bee-4bde-bb48-98a065d1c0e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.218646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27210449-5bee-4bde-bb48-98a065d1c0e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.218934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27210449-5bee-4bde-bb48-98a065d1c0e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.219249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27210449-5bee-4bde-bb48-98a065d1c0e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.221871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811204-db7e-4634-8414-ddd442c3403e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.240869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.241511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.241795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.242073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.242778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.244829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.278206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 962/1925] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:06.279994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.290073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc11bf-82cb-46b5-853f-f39e06d36e0a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.302597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.303400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.303763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.304110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.304964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.309196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.328852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27210449-5bee-4bde-bb48-98a065d1c0e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.332368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 963/1926] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:06.333743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.334240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27210449-5bee-4bde-bb48-98a065d1c0e2 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.348741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc0a4b-8728-496a-99c7-cdf7c8a7db6b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.355898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.356553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.356814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.357092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] PATH_INFO: `/v3/projects/b38e2080c01c4ac5a5b2f988e79a9f30/users/f37deb80b6234bc982cd5c5c7c802c1d/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.361024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 964/1927] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:06.375078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38e2080c01c4ac5a5b2f988e79a9f30, user_id=f37deb80b6234bc982cd5c5c7c802c1d, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.377789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.401763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 964/1928] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:06 2022] PUT /identity/v3/projects/b38e2080c01c4ac5a5b2f988e79a9f30/users/f37deb80b6234bc982cd5c5c7c802c1d/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:06.429550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.429914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.430263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.474263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] MFA Rules not processed for user `f37deb80b6234bc982cd5c5c7c802c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:06.475667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:06.552285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.554495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:06.595114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 965/1929] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:06.623396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.624597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:06.664653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466163da-04ce-4da2-91e7-cfa60c739efd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.676472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.676792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.677241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.678159 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] PATH_INFO: `/v3/projects/6b240043b472418881d09c11e2d360c5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.679801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b240043b472418881d09c11e2d360c5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.682507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.683587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:06.708405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea019b9-b978-4924-a46c-9d19fa424f1a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.713340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.714605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.715240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.715240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.726260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.729490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.732282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:06.757345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 966/1930] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:06.761954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b240043b472418881d09c11e2d360c5', 'request_id': 'req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:06.773406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b240043b472418881d09c11e2d360c5', 'request_id': 'req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:06.783174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b240043b472418881d09c11e2d360c5', 'request_id': 'req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:06.800835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] The token cache is being invalidate because project 6b240043b472418881d09c11e2d360c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:06.801413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:06.802712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:06.805098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 965/1931] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:06 2022] DELETE /identity/v3/projects/6b240043b472418881d09c11e2d360c5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:06.809390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:06.822254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb00e-4b61-41a6-bfd8-047c9fdffc98 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:06.902279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:06.902952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:06.903234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:06.903594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] PATH_INFO: `/v3/users/c34a6e76847f4afe8a786e2b7cc63134` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:06.905148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34a6e76847f4afe8a786e2b7cc63134)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:06.907960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:06.997309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34a6e76847f4afe8a786e2b7cc63134'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:06.998201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34a6e76847f4afe8a786e2b7cc63134'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:06.998851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34a6e76847f4afe8a786e2b7cc63134'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:07.020504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34a6e76847f4afe8a786e2b7cc63134'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:07.029843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34a6e76847f4afe8a786e2b7cc63134'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:07.066252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 967/1932] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:06 2022] DELETE /identity/v3/users/c34a6e76847f4afe8a786e2b7cc63134 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:07.413407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:07.415280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:07.483686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602aadd6-e99f-4fa4-b346-a96ccba9ddb4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:07.547098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcf549-8270-466c-8a55-cc3b7c803080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:07.548096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf549-8270-466c-8a55-cc3b7c803080 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:07.548943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf549-8270-466c-8a55-cc3b7c803080 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:07.548943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf549-8270-466c-8a55-cc3b7c803080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:07.551367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3dbcf549-8270-466c-8a55-cc3b7c803080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:07.631844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcf549-8270-466c-8a55-cc3b7c803080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:07.634494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcf549-8270-466c-8a55-cc3b7c803080 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:07.655420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 966/1933] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:07.768024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:07.771254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:07.891734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82d404-6fd7-4071-bc04-fd45cf3e1e09 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:07.897190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:07.897462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:07.897746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:07.898024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] PATH_INFO: `/v3/projects/d96b99ef6a324c79b3892d5307499b35` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:07.899291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96b99ef6a324c79b3892d5307499b35)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:07.901359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:07.904306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:07.973569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96b99ef6a324c79b3892d5307499b35', 'request_id': 'req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:07.981630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96b99ef6a324c79b3892d5307499b35', 'request_id': 'req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:07.994462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96b99ef6a324c79b3892d5307499b35', 'request_id': 'req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:08.009346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] The token cache is being invalidate because project d96b99ef6a324c79b3892d5307499b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:08.010622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:08.011146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a4ee6018-50b9-48bc-8eab-3dcb36b032b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:08.015308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 968/1934] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:07 2022] DELETE /identity/v3/projects/d96b99ef6a324c79b3892d5307499b35 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:08.018289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c96431-74ea-4d12-a551-b7583b0ae553 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.018580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c96431-74ea-4d12-a551-b7583b0ae553 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.018805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c96431-74ea-4d12-a551-b7583b0ae553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.042267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e0c96431-74ea-4d12-a551-b7583b0ae553 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:08.043495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e0c96431-74ea-4d12-a551-b7583b0ae553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:08.065498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:08.132410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 967/1935] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:08.133457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a649b-7fc7-445b-973e-d99fc9efa6a3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.133930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a649b-7fc7-445b-973e-d99fc9efa6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.134009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a649b-7fc7-445b-973e-d99fc9efa6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.159742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cd9a649b-7fc7-445b-973e-d99fc9efa6a3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:08.161264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cd9a649b-7fc7-445b-973e-d99fc9efa6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:08.174948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 969/1936] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:08.176371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c96431-74ea-4d12-a551-b7583b0ae553 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.189108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c96431-74ea-4d12-a551-b7583b0ae553 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.205851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:08.206511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.208851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.208851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.208851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:08.208851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:08.220601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:08.254594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a649b-7fc7-445b-973e-d99fc9efa6a3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.256503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 968/1937] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:08.268648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a649b-7fc7-445b-973e-d99fc9efa6a3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.280667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:08.281518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.281827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.282105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.282797 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:08.284757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:08.333725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 970/1938] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:08 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:08.337293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.349947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3000-a779-45e0-8d7e-9f039a70f7be admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.427111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:08.427896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.428183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.428607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.429473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:08.431516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:08.464727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 969/1939] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:08 2022] POST /identity/v3/users => generated 282 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:08.471391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.482300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42657774-e5aa-4a8d-9a8a-315296b65051 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.488055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:08.488757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.489065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.489346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.490202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:08.492285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:08.516862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 971/1940] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:08.521013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.541499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fab4-de3e-464b-903d-3537b53c09ed admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.547324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa9b4e-77f8-4281-ad43-5d9384bf2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:08.548148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa9b4e-77f8-4281-ad43-5d9384bf2a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.548534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa9b4e-77f8-4281-ad43-5d9384bf2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.548917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa9b4e-77f8-4281-ad43-5d9384bf2a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.549724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa9b4e-77f8-4281-ad43-5d9384bf2a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:08.551477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa9b4e-77f8-4281-ad43-5d9384bf2a01 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:08.563254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 970/1941] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:08.567468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.579892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f7a90-fadb-45af-bab0-6cc5a6d12af1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.589278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:08.590060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.590306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.590653 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] PATH_INFO: `/v3/projects/e47e2e5a10ea48ab81ab22dde5e5c06c/users/cb8d4c33478a4cc3bcf2cf5b8a58d818/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.612186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47e2e5a10ea48ab81ab22dde5e5c06c, user_id=cb8d4c33478a4cc3bcf2cf5b8a58d818, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:08.615533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:08.641161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 972/1942] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:08 2022] PUT /identity/v3/projects/e47e2e5a10ea48ab81ab22dde5e5c06c/users/cb8d4c33478a4cc3bcf2cf5b8a58d818/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:08.642916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c10d81-cb84-422c-ace4-d58609674117 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.643400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c10d81-cb84-422c-ace4-d58609674117 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.643540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c10d81-cb84-422c-ace4-d58609674117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.678413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d6c10d81-cb84-422c-ace4-d58609674117 None None] MFA Rules not processed for user `cb8d4c33478a4cc3bcf2cf5b8a58d818`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:08.679869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d6c10d81-cb84-422c-ace4-d58609674117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:08.790301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 971/1943] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:08.794464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.873873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a1a2f-d644-47c2-a7f2-af6e3afe3fd8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.879050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:08.879870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:08.880218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:08.880618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:08.881608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:08.883696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:08.919433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 973/1944] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:08 2022] POST /identity/v3/projects => generated 363 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:08.921870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c10d81-cb84-422c-ace4-d58609674117 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:08.934008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c10d81-cb84-422c-ace4-d58609674117 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:08.957202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:09.019516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:09.020283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:09.020686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:09.020899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:09.021657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:09.024190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:09.061953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 972/1945] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:08 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:09.064576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:09.077862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339848-c948-4c62-9270-a7fcadae929f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:09.088120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:09.089176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:09.089557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:09.090119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:09.090937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:09.094164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:09.145125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 974/1946] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:09.149002 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:09.162832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff013a5-4473-47dd-8cee-2142aec8a86e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:09.184340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:09.185082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:09.185372 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:09.185656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] PATH_INFO: `/v3/projects/60292982ddac4a7b8ff99f0cbf11d01b/users/cfd431706dfd48b4baa80d86aa258d44/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:09.213383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60292982ddac4a7b8ff99f0cbf11d01b, user_id=cfd431706dfd48b4baa80d86aa258d44, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:09.216710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:09.236551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 973/1947] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:09 2022] PUT /identity/v3/projects/60292982ddac4a7b8ff99f0cbf11d01b/users/cfd431706dfd48b4baa80d86aa258d44/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:09.240907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:09.248169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:09.254461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f04937-c178-4444-a954-491a25088b9a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:09.349220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad66f8-8f5e-48d5-be7a-4b97af256383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:09.350227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad66f8-8f5e-48d5-be7a-4b97af256383 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:09.350665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad66f8-8f5e-48d5-be7a-4b97af256383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:09.351093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad66f8-8f5e-48d5-be7a-4b97af256383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:09.351964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad66f8-8f5e-48d5-be7a-4b97af256383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:09.354315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad66f8-8f5e-48d5-be7a-4b97af256383 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:09.375588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 975/1948] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:09.376864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:09.398262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef119e-9baf-4ae1-b2bb-d0fa4dc83696 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:09.413041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:09.414023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:09.414460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:09.414889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] PATH_INFO: `/v3/projects/60292982ddac4a7b8ff99f0cbf11d01b/users/cfd431706dfd48b4baa80d86aa258d44/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:09.418712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60292982ddac4a7b8ff99f0cbf11d01b, user_id=cfd431706dfd48b4baa80d86aa258d44, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:09.422761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:09.447618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 974/1949] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:09 2022] PUT /identity/v3/projects/60292982ddac4a7b8ff99f0cbf11d01b/users/cfd431706dfd48b4baa80d86aa258d44/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:09.462331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de07b-4b04-4f91-bac2-c62457270583 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:09.463325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de07b-4b04-4f91-bac2-c62457270583 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:09.464139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de07b-4b04-4f91-bac2-c62457270583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:09.562396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bd7de07b-4b04-4f91-bac2-c62457270583 None None] MFA Rules not processed for user `cfd431706dfd48b4baa80d86aa258d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:09.566086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bd7de07b-4b04-4f91-bac2-c62457270583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:09.794529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 976/1950] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:09.862305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:09.863045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:10.018489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f45f6-d130-4c48-9fa5-343057f19139 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:10.029731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:10.030666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:10.032347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:10.033094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:10.063587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:10.066812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:10.080142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 975/1951] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:10.211390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de07b-4b04-4f91-bac2-c62457270583 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:10.226699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de07b-4b04-4f91-bac2-c62457270583 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:10.235254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:10.235947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:10.236230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:10.236506 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:10.381660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:10.383300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:10.421717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 977/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:12.662489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:12.676973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2614e1-bae5-49e9-a0e6-e0bad71132e5 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:12.683056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffa4e-5fc4-4960-9e02-0c09ca9097f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:12.684090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffa4e-5fc4-4960-9e02-0c09ca9097f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:12.684430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffa4e-5fc4-4960-9e02-0c09ca9097f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:12.684699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffa4e-5fc4-4960-9e02-0c09ca9097f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:12.686713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c1ffa4e-5fc4-4960-9e02-0c09ca9097f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:12.815395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffa4e-5fc4-4960-9e02-0c09ca9097f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:12.817152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffa4e-5fc4-4960-9e02-0c09ca9097f2 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:12.833185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 976/1953] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:13.341456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:13.343673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:13.389648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:13.455926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71bb6a-b500-4e69-8065-75149cf9f955 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:13.470731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:13.471590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:13.472977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:13.473448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] PATH_INFO: `/v3/users/f37deb80b6234bc982cd5c5c7c802c1d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:13.474935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37deb80b6234bc982cd5c5c7c802c1d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:13.491355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:13.601928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37deb80b6234bc982cd5c5c7c802c1d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.603310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37deb80b6234bc982cd5c5c7c802c1d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.604301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37deb80b6234bc982cd5c5c7c802c1d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.622771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37deb80b6234bc982cd5c5c7c802c1d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.635622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37deb80b6234bc982cd5c5c7c802c1d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.664941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 978/1954] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:13 2022] DELETE /identity/v3/users/f37deb80b6234bc982cd5c5c7c802c1d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:13.670009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:13.671100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:13.671611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:13.675735 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:13.677567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:13.693940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:13.695373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:13.705535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:13.786447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e2af6-d675-40e3-ba44-1584154b26e5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:13.793687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:13.794427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:13.795344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:13.795643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] PATH_INFO: `/v3/users/cb8d4c33478a4cc3bcf2cf5b8a58d818` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:13.798010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8d4c33478a4cc3bcf2cf5b8a58d818)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:13.798939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 977/1955] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:13.800618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:13.809669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:13.815200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:13.893540 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:13.896979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8d4c33478a4cc3bcf2cf5b8a58d818'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.898012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8d4c33478a4cc3bcf2cf5b8a58d818'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.898563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8d4c33478a4cc3bcf2cf5b8a58d818'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.909472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19de2e2-7dcb-4a2e-a2a1-bc4b3c45e5cd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:13.914773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:13.915907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:13.916228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:13.916603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:13.918186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8d4c33478a4cc3bcf2cf5b8a58d818'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.918774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:13.928340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ecf4fd37-6fa6-42e4-a6ee-972c203c9900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8d4c33478a4cc3bcf2cf5b8a58d818'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:13.934594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:13.936170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:13.946258 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 979/1956] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:13 2022] DELETE /identity/v3/users/cb8d4c33478a4cc3bcf2cf5b8a58d818 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:13.947651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 978/1957] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:13.951459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:13.951846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:13.952219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:13.973520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:13.974819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:14.064496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 980/1958] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:14.082103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:14.083693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:14.112123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd818d-97f5-4274-893f-8e3ffa02c11a service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:14.195698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015028ec-f10b-43c3-856f-9c0474d87996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:14.196728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015028ec-f10b-43c3-856f-9c0474d87996 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:14.198383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015028ec-f10b-43c3-856f-9c0474d87996 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:14.198902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015028ec-f10b-43c3-856f-9c0474d87996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:14.225042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015028ec-f10b-43c3-856f-9c0474d87996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:14.226777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015028ec-f10b-43c3-856f-9c0474d87996 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:14.242140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 979/1959] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:14.524115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:14.528983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:14.561039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f6f92-81bd-49c6-9a88-ea18b6187600 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:14.575127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:14.575483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:14.575792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:14.576072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] PATH_INFO: `/v3/projects/b38e2080c01c4ac5a5b2f988e79a9f30` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:14.579896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38e2080c01c4ac5a5b2f988e79a9f30)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:14.581886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:14.703047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38e2080c01c4ac5a5b2f988e79a9f30', 'request_id': 'req-e040692c-6daf-4654-9922-ad85f9e47c7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:14.720597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38e2080c01c4ac5a5b2f988e79a9f30', 'request_id': 'req-e040692c-6daf-4654-9922-ad85f9e47c7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:14.744983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38e2080c01c4ac5a5b2f988e79a9f30', 'request_id': 'req-e040692c-6daf-4654-9922-ad85f9e47c7d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:14.757592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] The token cache is being invalidate because project b38e2080c01c4ac5a5b2f988e79a9f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:14.758006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:14.758606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e040692c-6daf-4654-9922-ad85f9e47c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:14.761238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 981/1960] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:14 2022] DELETE /identity/v3/projects/b38e2080c01c4ac5a5b2f988e79a9f30 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:14.765815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f5a4d-d8f2-4748-a020-78154b849441 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:14.766315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f5a4d-d8f2-4748-a020-78154b849441 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:14.766405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f5a4d-d8f2-4748-a020-78154b849441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:14.793954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-111f5a4d-d8f2-4748-a020-78154b849441 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:14.795405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-111f5a4d-d8f2-4748-a020-78154b849441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:14.866577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:14.878142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 980/1961] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:14.886247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:14.886639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:14.886898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:14.914592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:14.922985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:14.934269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 982/1962] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:14.939299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f5a4d-d8f2-4748-a020-78154b849441 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:14.950627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f5a4d-d8f2-4748-a020-78154b849441 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:14.958961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:14.960222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:14.960510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:14.960787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:14.961614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:14.961959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:14.965612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:14.987717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:14.989165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:14.991452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 981/1963] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:14.995942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.010428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760dcaf-7c4a-466f-b913-6b13e3ccf1df admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.010881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80b39-4ff7-4797-9a54-e92b4f0af933 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.016279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.016905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.017310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.017545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] PATH_INFO: `/v3/projects/e47e2e5a10ea48ab81ab22dde5e5c06c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.018417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.018884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47e2e5a10ea48ab81ab22dde5e5c06c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.019193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.019721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.019964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.020855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.020970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.023355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.073444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 982/1964] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:14 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:15.074478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.084337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:15.103590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47e2e5a10ea48ab81ab22dde5e5c06c', 'request_id': 'req-624fc25a-0776-412a-842d-beab7fb28db3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.110904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47e2e5a10ea48ab81ab22dde5e5c06c', 'request_id': 'req-624fc25a-0776-412a-842d-beab7fb28db3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.123774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47e2e5a10ea48ab81ab22dde5e5c06c', 'request_id': 'req-624fc25a-0776-412a-842d-beab7fb28db3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.138421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] The token cache is being invalidate because project e47e2e5a10ea48ab81ab22dde5e5c06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:15.138783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.139449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.141326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 983/1965] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:14 2022] DELETE /identity/v3/projects/e47e2e5a10ea48ab81ab22dde5e5c06c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:15.145464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.146940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.162448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45730f74-30e1-4ec2-97aa-fc869a21500e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.224871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc25a-0776-412a-842d-beab7fb28db3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.231025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.231715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.231999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.232268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] PATH_INFO: `/v3/users/cfd431706dfd48b4baa80d86aa258d44` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.233891 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd431706dfd48b4baa80d86aa258d44)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.236094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.242115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.244136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.245034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.245312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.245995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.248058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.280861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 983/1966] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:15 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:15.284704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.286802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.292758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd431706dfd48b4baa80d86aa258d44'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.293435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd431706dfd48b4baa80d86aa258d44'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.294126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd431706dfd48b4baa80d86aa258d44'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.314354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd431706dfd48b4baa80d86aa258d44'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.316134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbfb29-92c9-45ba-b364-3c6b1058f4bc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.324442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd431706dfd48b4baa80d86aa258d44'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.324789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.325228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.325526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.325811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.326554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.328409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.340128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 984/1967] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:19:15.340897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 984/1968] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:15 2022] DELETE /identity/v3/users/cfd431706dfd48b4baa80d86aa258d44 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:15.347225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.349403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.365796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2de09-e65a-439c-bad7-1c0ed3e4213b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.433851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.435390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.454803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:15.471669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.472534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.473088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.473379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.474630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.477073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.494563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 985/1969] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:15.500155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.501592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:15.520141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944dce3-0bc0-42f4-a59d-178fdd75b9d1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.529476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4e4bb-e895-4ceb-a666-6f3d6f8db09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.530316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e4bb-e895-4ceb-a666-6f3d6f8db09d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.530702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e4bb-e895-4ceb-a666-6f3d6f8db09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.531115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e4bb-e895-4ceb-a666-6f3d6f8db09d admin admin] PATH_INFO: `/v3/projects/8f9ba2b659774e419ba3e04a089fecbd/users/fa2eb07013f14eaf9091c444d684c30e/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.538657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd932-3f92-4f23-8399-9d5ec6ff1a9e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.546726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.547435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.547929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.548214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] PATH_INFO: `/v3/users/14e8aa31356249b898226bba59fee42a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.549567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e8aa31356249b898226bba59fee42a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.552419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.556945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4e4bb-e895-4ceb-a666-6f3d6f8db09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9ba2b659774e419ba3e04a089fecbd, user_id=fa2eb07013f14eaf9091c444d684c30e, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.560254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4e4bb-e895-4ceb-a666-6f3d6f8db09d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.580527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 986/1970] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:15 2022] PUT /identity/v3/projects/8f9ba2b659774e419ba3e04a089fecbd/users/fa2eb07013f14eaf9091c444d684c30e/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:15.592122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.592385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.592685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.609532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e8aa31356249b898226bba59fee42a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.610557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e8aa31356249b898226bba59fee42a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.611069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e8aa31356249b898226bba59fee42a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.629222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e8aa31356249b898226bba59fee42a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.638601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5950651f-ad7f-48e3-b844-b649c0565e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e8aa31356249b898226bba59fee42a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:15.639972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] MFA Rules not processed for user `fa2eb07013f14eaf9091c444d684c30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:15.641221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.654078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 985/1971] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:15 2022] DELETE /identity/v3/users/14e8aa31356249b898226bba59fee42a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:15.658481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.658779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.659562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.682678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:15.683946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.730624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 987/1972] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:15.736290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.738147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.766417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 986/1973] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:15.779023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.780648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.824204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21030-4a91-4548-90d1-2d6c5ace2556 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.828940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.829559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.829842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.830122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.830859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.832785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.861643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0378a-7b5f-44cb-ba5a-ddad94e7418d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.864716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 988/1974] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:15 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:15.865511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.867867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:15.869086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.869730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.870057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.870336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.903218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.908791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:15.924449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 987/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:15.925478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:15.930496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:15.936691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1778d44-c2c3-4250-a7be-e6f08badd175 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.941100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:15.971862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea760-7424-4331-9931-5dac55e65d24 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:15.977517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:15.979179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:15.979587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:15.980427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] PATH_INFO: `/v3/projects/60292982ddac4a7b8ff99f0cbf11d01b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:15.981890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60292982ddac4a7b8ff99f0cbf11d01b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:15.984985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.033734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.034368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.035331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.035625 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.036454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.038910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.072369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60292982ddac4a7b8ff99f0cbf11d01b', 'request_id': 'req-49cdb15f-c12b-4893-9919-1074c838087f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.075063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 988/1976] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:15 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:16.081134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.083843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60292982ddac4a7b8ff99f0cbf11d01b', 'request_id': 'req-49cdb15f-c12b-4893-9919-1074c838087f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.094821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6ce8b-9365-4642-9586-af8ebb60242e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.095001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60292982ddac4a7b8ff99f0cbf11d01b', 'request_id': 'req-49cdb15f-c12b-4893-9919-1074c838087f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.126577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] The token cache is being invalidate because project 60292982ddac4a7b8ff99f0cbf11d01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:16.127008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.127844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-49cdb15f-c12b-4893-9919-1074c838087f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.130683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 989/1977] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:15 2022] DELETE /identity/v3/projects/60292982ddac4a7b8ff99f0cbf11d01b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:16.135475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec17ba-1fae-4d2a-b4dc-ecda6924b22f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.135765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec17ba-1fae-4d2a-b4dc-ecda6924b22f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.136055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec17ba-1fae-4d2a-b4dc-ecda6924b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.209459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-10ec17ba-1fae-4d2a-b4dc-ecda6924b22f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:16.210706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-10ec17ba-1fae-4d2a-b4dc-ecda6924b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.216902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.217839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.218959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.219244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.220090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.222439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.225420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 990/1978] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:16.233281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812b23-01a7-4317-8306-50cb64a8e40f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.233835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812b23-01a7-4317-8306-50cb64a8e40f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.234114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812b23-01a7-4317-8306-50cb64a8e40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.244915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 989/1979] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:16.249393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.257374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.270486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-04812b23-01a7-4317-8306-50cb64a8e40f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:16.270486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-04812b23-01a7-4317-8306-50cb64a8e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.280655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5e3cd-1888-4f3b-82e1-4c1c404548ff admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.281133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 991/1980] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:16.285634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04812b23-01a7-4317-8306-50cb64a8e40f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.296630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.298013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.298127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.298438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] PATH_INFO: `/v3/projects/1af85b9d9a9240489132638980d93f2b/users/166f9bfafec0412eb38e2a15cc12b9ff/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.303780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04812b23-01a7-4317-8306-50cb64a8e40f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.313202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.313861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.314494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.314780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.315634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:16.315842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.317923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.323718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af85b9d9a9240489132638980d93f2b, user_id=166f9bfafec0412eb38e2a15cc12b9ff, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.326585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.346206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 992/1981] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:16.348389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.350572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 990/1982] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:16 2022] PUT /identity/v3/projects/1af85b9d9a9240489132638980d93f2b/users/166f9bfafec0412eb38e2a15cc12b9ff/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:16.351461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.354639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.369878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae2fe-7bef-41b8-bcb6-7249bf614297 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.441195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.441843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.441948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4d529-696b-4314-8b53-e31ea5809fc1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.442272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.442563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] PATH_INFO: `/v3/projects/458c31afc263497793c8856062f4ba52` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.443760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458c31afc263497793c8856062f4ba52)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.445706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.446528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.447350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.447532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.447779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.448447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.450427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.460080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:16.482681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 991/1983] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:16 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:16.483786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.494590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:16.499233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458c31afc263497793c8856062f4ba52', 'request_id': 'req-e6d6c933-d435-4280-b0da-9a5e5e34fac5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.507821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458c31afc263497793c8856062f4ba52', 'request_id': 'req-e6d6c933-d435-4280-b0da-9a5e5e34fac5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.516617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458c31afc263497793c8856062f4ba52', 'request_id': 'req-e6d6c933-d435-4280-b0da-9a5e5e34fac5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.530452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] The token cache is being invalidate because project 458c31afc263497793c8856062f4ba52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:16.530771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.531479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.533438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 993/1984] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:16 2022] DELETE /identity/v3/projects/458c31afc263497793c8856062f4ba52 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:16.536215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.538009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.552941 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86126eb-f914-476c-8d6e-7d160fca310b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.606784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6c933-d435-4280-b0da-9a5e5e34fac5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.609583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.610215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.610499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.610782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.611522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.611952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.612571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.612859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.613134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.613247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.613931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.615901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.623559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 992/1985] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:16.624547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.628421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.641064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 994/1986] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:16 2022] POST /identity/v3/users => generated 305 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:16.641064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.642010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15071-89fb-4708-ac94-2485a8f695dd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.642368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.646655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.647321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.647612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.647890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] PATH_INFO: `/v3/users/342c660d1f8a4e708b6d359129db0b02` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.649070 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=342c660d1f8a4e708b6d359129db0b02)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.651581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.656410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ff595-6549-4384-8472-88c7242b759e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.661198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.661865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.662154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.662430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] PATH_INFO: `/v3/projects/1af85b9d9a9240489132638980d93f2b/users/166f9bfafec0412eb38e2a15cc12b9ff/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.664390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af85b9d9a9240489132638980d93f2b, user_id=166f9bfafec0412eb38e2a15cc12b9ff, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.667741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.678417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 995/1987] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:16 2022] PUT /identity/v3/projects/1af85b9d9a9240489132638980d93f2b/users/166f9bfafec0412eb38e2a15cc12b9ff/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:16.679313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.711492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342c660d1f8a4e708b6d359129db0b02'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.712816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342c660d1f8a4e708b6d359129db0b02'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.714303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342c660d1f8a4e708b6d359129db0b02'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.745308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342c660d1f8a4e708b6d359129db0b02'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.754935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3544aa54-9deb-482f-811c-0d0cb9ad1b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342c660d1f8a4e708b6d359129db0b02'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:16.765884 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419cc0-36fd-43dc-b299-86d268e4245e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.771623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.772399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.772686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.772992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.773695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.773817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 993/1988] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:16 2022] DELETE /identity/v3/users/342c660d1f8a4e708b6d359129db0b02 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:16.776389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.778993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.778993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.779190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.787202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:16.787815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 996/1989] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:16.792545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.794504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.809366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99002be7-15fa-4286-ac92-e228f97df05a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.817098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] MFA Rules not processed for user `166f9bfafec0412eb38e2a15cc12b9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:16.818381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.858799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:16.885330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.886227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.886515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.886849 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.887645 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.889344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.900850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 997/1990] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:19:16.905769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.909719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 994/1991] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:16.921855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:16.922542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1b45e-1872-44d2-a06a-c09c36f98956 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:16.924082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:16.935695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c387-1816-439f-9c48-4a6b9770b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:16.936393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c387-1816-439f-9c48-4a6b9770b63a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.936985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c387-1816-439f-9c48-4a6b9770b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.937341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c387-1816-439f-9c48-4a6b9770b63a admin admin] PATH_INFO: `/v3/projects/1f3b48201a0d4da781c28a3a64890e82/users/5ddd599bf30c423cab1d67bc7c2fc437/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.959716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c387-1816-439f-9c48-4a6b9770b63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3b48201a0d4da781c28a3a64890e82, user_id=5ddd599bf30c423cab1d67bc7c2fc437, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:16.963119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c387-1816-439f-9c48-4a6b9770b63a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:16.979071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 998/1992] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:16 2022] PUT /identity/v3/projects/1f3b48201a0d4da781c28a3a64890e82/users/5ddd599bf30c423cab1d67bc7c2fc437/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:16.989801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:16.990164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:16.990364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:16.998522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b67f6-a44b-4cc6-aa70-c7aabf54c18d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.020320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] MFA Rules not processed for user `5ddd599bf30c423cab1d67bc7c2fc437`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:17.021838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:17.057019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.057857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.058128 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.058619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.061038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:17.127396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 999/1993] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:17.128533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.130204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:17.149097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.150855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.155584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:17.161748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 995/1994] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:17.162550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.198594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c837ff-bdfa-49d4-90c0-9f10008ac6e9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.203439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.204086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.204366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.204647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] PATH_INFO: `/v3/projects/48a4857b6d9e4d0eb3447dab2de60330` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.205815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a4857b6d9e4d0eb3447dab2de60330)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.207768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.239322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dea53e-d643-4c9c-b80f-ba2657a9d408 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.247308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.247972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.248246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.248668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.255326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.255326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.257812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:17.260364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a4857b6d9e4d0eb3447dab2de60330', 'request_id': 'req-42999990-eb3a-45dd-ac71-1f8049847fd3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.270984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a4857b6d9e4d0eb3447dab2de60330', 'request_id': 'req-42999990-eb3a-45dd-ac71-1f8049847fd3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.279738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a4857b6d9e4d0eb3447dab2de60330', 'request_id': 'req-42999990-eb3a-45dd-ac71-1f8049847fd3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.286333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 996/1995] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:17 2022] POST /identity/v3/projects => generated 407 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:17.287477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.293114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] The token cache is being invalidate because project 48a4857b6d9e4d0eb3447dab2de60330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:17.293408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.294083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.295883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1000/1996] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:17 2022] DELETE /identity/v3/projects/48a4857b6d9e4d0eb3447dab2de60330 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:17.299863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.301541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:17.376673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa999-8bff-4f08-bbe1-33f846a4ea13 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.384067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.384845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.385119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.385440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.387728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.389796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.407222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42999990-eb3a-45dd-ac71-1f8049847fd3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.414123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.414911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.414911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.415246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] PATH_INFO: `/v3/users/09941bb759fa48c0932a9a756fe9c42b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.417769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09941bb759fa48c0932a9a756fe9c42b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.421038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.436319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 997/1997] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:17 2022] POST /identity/v3/users => generated 310 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:17.437237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.439515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:17.456550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409ca66-8ef4-4839-8022-9ecf3966e953 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.462750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.463575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.463681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.463963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.464818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.466719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.480071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 998/1998] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:17.484655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.489874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09941bb759fa48c0932a9a756fe9c42b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.495879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a315d-73ee-44dc-9dc2-9aa555167e12 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.504304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09941bb759fa48c0932a9a756fe9c42b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.521581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09941bb759fa48c0932a9a756fe9c42b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.522115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.522872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09941bb759fa48c0932a9a756fe9c42b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.523028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.523916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.524173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09941bb759fa48c0932a9a756fe9c42b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:17.524529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] PATH_INFO: `/v3/projects/7c00886902fc444fb7b8c5c086083fa4/users/31a0bac2fa204943a6643adb201a7f25/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.555201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1001/1999] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:17 2022] DELETE /identity/v3/users/09941bb759fa48c0932a9a756fe9c42b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:17.559092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c00886902fc444fb7b8c5c086083fa4, user_id=31a0bac2fa204943a6643adb201a7f25, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.579620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.610211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 999/2000] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:17 2022] PUT /identity/v3/projects/7c00886902fc444fb7b8c5c086083fa4/users/31a0bac2fa204943a6643adb201a7f25/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:17.615010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.616672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:17.705007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:17.711989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae2a3e-b112-4d11-9bfa-1c8fd82a0a78 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.805382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52fbea-1e68-4f7b-8863-d4edeb8c47fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.806383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52fbea-1e68-4f7b-8863-d4edeb8c47fd admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.806676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52fbea-1e68-4f7b-8863-d4edeb8c47fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.806953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52fbea-1e68-4f7b-8863-d4edeb8c47fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.807703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52fbea-1e68-4f7b-8863-d4edeb8c47fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.810345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52fbea-1e68-4f7b-8863-d4edeb8c47fd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.829690 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1002/2001] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:17.833219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:17.848660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865daa6-1fcd-4327-bd41-373a573b3c1f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:17.854206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:17.855131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.855467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.856030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] PATH_INFO: `/v3/projects/7c00886902fc444fb7b8c5c086083fa4/users/31a0bac2fa204943a6643adb201a7f25/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.858040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c00886902fc444fb7b8c5c086083fa4, user_id=31a0bac2fa204943a6643adb201a7f25, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:17.861660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:17.884347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1000/2002] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:17 2022] PUT /identity/v3/projects/7c00886902fc444fb7b8c5c086083fa4/users/31a0bac2fa204943a6643adb201a7f25/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:17.886447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:17.887422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:17.887741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:17.935915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] MFA Rules not processed for user `31a0bac2fa204943a6643adb201a7f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:17.938106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:18.027816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.030425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:18.056421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1003/2003] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:17 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:18.069670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.071044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:18.093173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:18.151287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb3252-c4cd-4203-9844-7df55c4b2fcc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.153011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.153777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.154163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.154543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] PATH_INFO: `/v3/projects/d9f8990f5a0d4381a3e4b4c2d454d0c8` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.156101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f8990f5a0d4381a3e4b4c2d454d0c8)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.159383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.189361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfde72a-e4aa-426e-bafc-886f8c592cb8 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.195322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b59c75-67a3-44ff-a129-87d00da70174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.195697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59c75-67a3-44ff-a129-87d00da70174 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.196061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59c75-67a3-44ff-a129-87d00da70174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.197236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59c75-67a3-44ff-a129-87d00da70174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.207913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b59c75-67a3-44ff-a129-87d00da70174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.209601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b59c75-67a3-44ff-a129-87d00da70174 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.220674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f8990f5a0d4381a3e4b4c2d454d0c8', 'request_id': 'req-e9539c3c-2391-41ee-a982-19b53248c7f0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:18.226645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f8990f5a0d4381a3e4b4c2d454d0c8', 'request_id': 'req-e9539c3c-2391-41ee-a982-19b53248c7f0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:18.227502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1004/2004] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:18 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:18.237101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f8990f5a0d4381a3e4b4c2d454d0c8', 'request_id': 'req-e9539c3c-2391-41ee-a982-19b53248c7f0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:18.250979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] The token cache is being invalidate because project d9f8990f5a0d4381a3e4b4c2d454d0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:18.251391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:18.252163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e9539c3c-2391-41ee-a982-19b53248c7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:18.254102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1001/2005] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:18 2022] DELETE /identity/v3/projects/d9f8990f5a0d4381a3e4b4c2d454d0c8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:18.260099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe727eeb-95d1-4228-80b2-f72c118432ce None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.260447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe727eeb-95d1-4228-80b2-f72c118432ce None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.260739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe727eeb-95d1-4228-80b2-f72c118432ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.283822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fe727eeb-95d1-4228-80b2-f72c118432ce None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:18.285054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fe727eeb-95d1-4228-80b2-f72c118432ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:18.313233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:18.360776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1005/2006] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:18.371084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.371375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.371629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.392052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:18.393371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:18.405585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1002/2007] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:18.407450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe727eeb-95d1-4228-80b2-f72c118432ce None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.415894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.417609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:18.418130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe727eeb-95d1-4228-80b2-f72c118432ce None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.422747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.423590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.423923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.424248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.424943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:18.425263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.426839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.443322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1006/2008] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:19:18.446056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.456892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3607f-f565-429c-99eb-1c9ec7306c21 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.463671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.464676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.464982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.465360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.466063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.468648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.494919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241e6a-fefb-4e2f-80b0-cc4f5ba73085 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.499074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.499776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.500061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.500396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.502220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:18.503372 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1007/2009] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:18 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:18.506333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.573165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.574624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.580174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdac5a6-a6cb-49f9-9f1a-8f5712186909 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.584372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1003/2010] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:18.587859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.588579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.588938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.589296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.590050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.592547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.623221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1008/2011] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:18 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:18.627025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.646001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:18.654509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44cd11-8cdb-4a35-a74d-668935df7f32 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.662601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.663684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.664536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.665114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.668060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.670138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.687519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1004/2012] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:18.689527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.702457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ff02-09d4-457d-8a32-61e7e5026c23 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.708799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d08b2e-8cc2-42e6-814b-241ea3cb19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.709610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d08b2e-8cc2-42e6-814b-241ea3cb19a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.710037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d08b2e-8cc2-42e6-814b-241ea3cb19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.710479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d08b2e-8cc2-42e6-814b-241ea3cb19a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.711565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d08b2e-8cc2-42e6-814b-241ea3cb19a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.714680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d08b2e-8cc2-42e6-814b-241ea3cb19a1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.726424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1009/2013] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:19:18.731414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:18.746897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfab21-d1cd-4cf7-a7a3-bed7ac908bab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:18.756511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:18.757800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.758194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.759871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] PATH_INFO: `/v3/projects/30cbb93c6f5f4f8db5e258469d1bce82/users/771b3aad28e7402383b970ee1ee8f67e/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.787698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cbb93c6f5f4f8db5e258469d1bce82, user_id=771b3aad28e7402383b970ee1ee8f67e, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:18.796143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:18.822425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1005/2014] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:18 2022] PUT /identity/v3/projects/30cbb93c6f5f4f8db5e258469d1bce82/users/771b3aad28e7402383b970ee1ee8f67e/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:18.834739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af69b1-4521-4d57-8549-90bba7072a88 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:18.835042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af69b1-4521-4d57-8549-90bba7072a88 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:18.835397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af69b1-4521-4d57-8549-90bba7072a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:18.879551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-85af69b1-4521-4d57-8549-90bba7072a88 None None] MFA Rules not processed for user `771b3aad28e7402383b970ee1ee8f67e`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:18.879551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-85af69b1-4521-4d57-8549-90bba7072a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:19.011129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:19.021428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1010/2015] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:19.025078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.111882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41a2c-21f1-4be6-9e78-d581a0f71643 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.116701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.117406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.117820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.118167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.119542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.121607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.151918 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1006/2016] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:19 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:19.153195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af69b1-4521-4d57-8549-90bba7072a88 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.164980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af69b1-4521-4d57-8549-90bba7072a88 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.240011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.240740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.241120 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.241905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.242258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.244942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.276541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1011/2017] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:19 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:19.277734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.289286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed54035-89e4-421e-9b5d-21add793fe4a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.294515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.295350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.295728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.295981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.296673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.298458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.314823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1007/2018] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:19.318010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.333389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009586a-ac36-48fb-bec4-e2e99ef0a565 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.349072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.350077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.350358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.350656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] PATH_INFO: `/v3/projects/b0169030f7714e76b48434d9b1b8a903/users/c2653015400e41b197e621504b6dafc8/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.369467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0169030f7714e76b48434d9b1b8a903, user_id=c2653015400e41b197e621504b6dafc8, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.376056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.396974 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1012/2019] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:19 2022] PUT /identity/v3/projects/b0169030f7714e76b48434d9b1b8a903/users/c2653015400e41b197e621504b6dafc8/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:19.401626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.412467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2aded-ff26-4dd2-bc78-43f7ba7d20ab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.496462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.497668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.498482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.498929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.499828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.501775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.518505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1008/2020] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:19.519610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.533581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0f622-f3ab-4382-95ba-7b20c3f3284a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.545262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614cd7d-8d93-4ecb-8dcb-70448f936d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.546856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cd7d-8d93-4ecb-8dcb-70448f936d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.547319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cd7d-8d93-4ecb-8dcb-70448f936d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.547762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cd7d-8d93-4ecb-8dcb-70448f936d8e admin admin] PATH_INFO: `/v3/projects/b0169030f7714e76b48434d9b1b8a903/users/c2653015400e41b197e621504b6dafc8/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.551646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614cd7d-8d93-4ecb-8dcb-70448f936d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0169030f7714e76b48434d9b1b8a903, user_id=c2653015400e41b197e621504b6dafc8, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.554726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614cd7d-8d93-4ecb-8dcb-70448f936d8e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.564165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.575934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1013/2021] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:19 2022] PUT /identity/v3/projects/b0169030f7714e76b48434d9b1b8a903/users/c2653015400e41b197e621504b6dafc8/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:19.586883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.588402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.588960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.623885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:19.629654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] MFA Rules not processed for user `c2653015400e41b197e621504b6dafc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:19.633612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:19.643673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344696a1-f548-4750-9144-480e4afff1c7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.712607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.713274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.713552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.713838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.715766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:19.751309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1014/2022] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:19.761825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.763092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:19.780004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c583c-37b4-44db-a091-4451e8faeede None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:19.787433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:19.788066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:19.788346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:19.788620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:19.804278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.806081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.818189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1015/2023] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:19.818598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:19.820245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:19.844585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1009/2024] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:19.939132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.944185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:19.988095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:19.999642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85d66c-eda0-4b53-93f6-ee774f6cf594 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:20.007380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6fc60-7368-46c8-9ec9-c9c0d29565e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:20.008106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fc60-7368-46c8-9ec9-c9c0d29565e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:20.008395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fc60-7368-46c8-9ec9-c9c0d29565e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:20.008674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fc60-7368-46c8-9ec9-c9c0d29565e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:20.013758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:20.098634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a403ad-5c59-43bd-8ddb-747b845e939d service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:20.105978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:20.106816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:20.106922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:20.107180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] PATH_INFO: `/v3/users/fa2eb07013f14eaf9091c444d684c30e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:20.108713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2eb07013f14eaf9091c444d684c30e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:20.110736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:20.124245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6fc60-7368-46c8-9ec9-c9c0d29565e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:20.125457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6fc60-7368-46c8-9ec9-c9c0d29565e3 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:20.140263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1010/2025] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:20.169141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2eb07013f14eaf9091c444d684c30e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:20.182141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2eb07013f14eaf9091c444d684c30e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:20.190944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2eb07013f14eaf9091c444d684c30e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:20.192043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2eb07013f14eaf9091c444d684c30e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:20.192539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2eb07013f14eaf9091c444d684c30e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:20.219329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1016/2026] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:19 2022] DELETE /identity/v3/users/fa2eb07013f14eaf9091c444d684c30e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:20.224115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:20.224427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:20.224712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:20.246469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:20.247971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:20.297660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:20.335166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1011/2027] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:20.346174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:20.348626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:20.455359 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea803b-4445-4517-8761-866ad3ac541c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:20.462628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:20.465110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:20.465497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:20.465780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:20.496763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:20.505982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:20.535741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1017/2028] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:21.053007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:21.054452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:21.070612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fac12-3d6e-412b-a5d7-4a8646baa7f7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:21.080976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:21.081990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:21.082533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:21.082940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] PATH_INFO: `/v3/projects/8f9ba2b659774e419ba3e04a089fecbd` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:21.084749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9ba2b659774e419ba3e04a089fecbd)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:21.089006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:21.186591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9ba2b659774e419ba3e04a089fecbd', 'request_id': 'req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.206724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9ba2b659774e419ba3e04a089fecbd', 'request_id': 'req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.228691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9ba2b659774e419ba3e04a089fecbd', 'request_id': 'req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.246382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] The token cache is being invalidate because project 8f9ba2b659774e419ba3e04a089fecbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:21.247044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.248467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.250906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1012/2029] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:21 2022] DELETE /identity/v3/projects/8f9ba2b659774e419ba3e04a089fecbd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:21.254740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:21.269936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bfbca-1513-4fdc-b414-2c9099ab65eb service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:21.381381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:21.423756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:21.424661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:21.425020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:21.425374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] PATH_INFO: `/v3/users/166f9bfafec0412eb38e2a15cc12b9ff` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:21.431989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166f9bfafec0412eb38e2a15cc12b9ff)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:21.434087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:21.497876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166f9bfafec0412eb38e2a15cc12b9ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.507463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166f9bfafec0412eb38e2a15cc12b9ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.516158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166f9bfafec0412eb38e2a15cc12b9ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.516932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166f9bfafec0412eb38e2a15cc12b9ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.517629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166f9bfafec0412eb38e2a15cc12b9ff'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:21.539203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1018/2030] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:21 2022] DELETE /identity/v3/users/166f9bfafec0412eb38e2a15cc12b9ff => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:21.942629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:21.944689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:21.960759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ff73-0f29-4ea1-a6a3-469b675eded3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.094717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.095569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.095876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.096169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] PATH_INFO: `/v3/projects/1af85b9d9a9240489132638980d93f2b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.097609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af85b9d9a9240489132638980d93f2b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.101966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.117283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.120877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.136919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e6e0-f4c3-4920-a19d-43017cacd615 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.142132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.142870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.143174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.143494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] PATH_INFO: `/v3/users/d25dac51d65a4d5d886cceedc213fa7c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.145090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25dac51d65a4d5d886cceedc213fa7c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.147927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.169646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af85b9d9a9240489132638980d93f2b', 'request_id': 'req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.177368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af85b9d9a9240489132638980d93f2b', 'request_id': 'req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.185758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af85b9d9a9240489132638980d93f2b', 'request_id': 'req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.196073 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:22.203781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25dac51d65a4d5d886cceedc213fa7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.206137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] The token cache is being invalidate because project 1af85b9d9a9240489132638980d93f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:22.206454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.208156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d6ac9eb-eaff-4526-9b95-b4240f96bc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.210322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1013/2031] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:21 2022] DELETE /identity/v3/projects/1af85b9d9a9240489132638980d93f2b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:22.216385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25dac51d65a4d5d886cceedc213fa7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.216573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd4935-4388-4123-b3e3-3be04c76c2ad None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.217288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd4935-4388-4123-b3e3-3be04c76c2ad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.217874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd4935-4388-4123-b3e3-3be04c76c2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.226530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25dac51d65a4d5d886cceedc213fa7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.228078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25dac51d65a4d5d886cceedc213fa7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.229662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b97d175e-51ec-4a60-b461-ad396495cc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25dac51d65a4d5d886cceedc213fa7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.247944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dcbd4935-4388-4123-b3e3-3be04c76c2ad None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:22.249271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dcbd4935-4388-4123-b3e3-3be04c76c2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.257229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1019/2032] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:22 2022] DELETE /identity/v3/users/d25dac51d65a4d5d886cceedc213fa7c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:22.324257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1014/2033] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:22.332028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.332323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.332602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.353944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:22.354975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.397348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:22.428319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1020/2034] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:22.432886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd4935-4388-4123-b3e3-3be04c76c2ad None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.442770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd4935-4388-4123-b3e3-3be04c76c2ad None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.448084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.448783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.449095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.449444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.450201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:22.450512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.452256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.458344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.459797 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.465445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1015/2035] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:22.469875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.480808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a5b94-7faf-4cc8-a07d-557e45950ea2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.480975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643b084-6b13-42b1-a6e5-8ad3388b1e38 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.486588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.487445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.487576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.487729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.488189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.488315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] PATH_INFO: `/v3/projects/1615d3c9a3fd4322903b4898f582fa8b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.488617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.488970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.489423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1615d3c9a3fd4322903b4898f582fa8b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.489555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.491673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.492118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.521702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1016/2036] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:22.526930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.547530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1615d3c9a3fd4322903b4898f582fa8b', 'request_id': 'req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.554970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1615d3c9a3fd4322903b4898f582fa8b', 'request_id': 'req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.562621 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1615d3c9a3fd4322903b4898f582fa8b', 'request_id': 'req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.581698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] The token cache is being invalidate because project 1615d3c9a3fd4322903b4898f582fa8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:22.581995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.582675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-3eadc4e7-44c8-4a19-8b5a-e8f4b8a32894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:22.584436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1021/2037] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:22 2022] DELETE /identity/v3/projects/1615d3c9a3fd4322903b4898f582fa8b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:22.590155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fde40-8136-4104-85b4-53868b1031c9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.590540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fde40-8136-4104-85b4-53868b1031c9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.590771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fde40-8136-4104-85b4-53868b1031c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.597639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b28f63-06da-45c5-a0d2-b1d6db2e0ee5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.620397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6d0fde40-8136-4104-85b4-53868b1031c9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:22.621652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d0fde40-8136-4104-85b4-53868b1031c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.667876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.668598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.669697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.669983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.670802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.673559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.694251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:22.704485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1022/2038] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:22.706301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdc94c-edc7-4511-b5a7-cde1c3d485ef None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.706596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdc94c-edc7-4511-b5a7-cde1c3d485ef None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.707489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdc94c-edc7-4511-b5a7-cde1c3d485ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.709594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1017/2039] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:22.714085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.716545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.730476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0d8a0-7ceb-445a-8070-f31250af0500 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.735843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.736685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.737281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.737281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.738095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.742696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.749222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ddcdc94c-edc7-4511-b5a7-cde1c3d485ef None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:22.750623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ddcdc94c-edc7-4511-b5a7-cde1c3d485ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.754584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1018/2040] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:22.755578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.760131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1023/2041] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:22.764184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdc94c-edc7-4511-b5a7-cde1c3d485ef None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.768889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb79c2-aa18-4da6-a18b-beb3289bfe5e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.773266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdc94c-edc7-4511-b5a7-cde1c3d485ef None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.774008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.774808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.775190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.775597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.776402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.778112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.778878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.779538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.779826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.780111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.780815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:22.781117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.782762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.792312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1019/2042] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:22.807597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.807742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1024/2043] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:19:22.807742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.813304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4b86-2626-4686-841c-eac4774460fc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.814962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d89a-4fa0-45d4-8304-cd5f2de2b9e6 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.817894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.818566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.818830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.819108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] PATH_INFO: `/v3/projects/b0ebdd719d1740bcbe2c1ad7f0837ff0/users/0b429a111ce241fe92c92c46dde19978/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.819903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ecc29-64b3-4866-b1d6-e3f122f08bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.820577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ecc29-64b3-4866-b1d6-e3f122f08bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.820932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ecc29-64b3-4866-b1d6-e3f122f08bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.822037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ecc29-64b3-4866-b1d6-e3f122f08bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.823582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ecc29-64b3-4866-b1d6-e3f122f08bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.825551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ecc29-64b3-4866-b1d6-e3f122f08bbb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.834050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ebdd719d1740bcbe2c1ad7f0837ff0, user_id=0b429a111ce241fe92c92c46dde19978, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:22.836849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:22.851147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1020/2044] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:22 2022] PUT /identity/v3/projects/b0ebdd719d1740bcbe2c1ad7f0837ff0/users/0b429a111ce241fe92c92c46dde19978/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:22.856585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1025/2045] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:22.860819 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.864212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.864613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.864898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.892328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] MFA Rules not processed for user `0b429a111ce241fe92c92c46dde19978`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:22.893524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.902206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:22.926178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d63a79-9e78-498a-be84-a365c438c87b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:22.973981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1026/2046] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:22.986537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:22.987922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:22.997021 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:22.997655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:22.997940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:22.998219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:22.998894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.000958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.024963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1021/2047] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:22 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:23.029243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:23.039168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e6118-93e0-4639-8bbc-1209eee4c52d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:23.044560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:23.045171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.045459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.045739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.046437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.048096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.060405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1022/2048] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:23.064315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:23.074927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df0d88-004d-4bc3-9513-403fbb4f434a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:23.080206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:23.080827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.081115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.081395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.082215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.083872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.084338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f870-6770-4316-9735-18d8f10a1a78 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:23.088514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:23.089321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.089677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.090024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.095389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1023/2049] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:19:23.099084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:23.099731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.101265 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.112019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1027/2050] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:23.121761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09663951-f073-4f3c-a862-0c6301dd3557 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:23.130838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:23.131368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf2032-bc72-4190-bd4b-6732e7bc8fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:23.132285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2032-bc72-4190-bd4b-6732e7bc8fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.132805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2032-bc72-4190-bd4b-6732e7bc8fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.133257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2032-bc72-4190-bd4b-6732e7bc8fad admin admin] PATH_INFO: `/v3/projects/e168c5eb0c474ff6909edf8176b354bc/users/4c9ce0f831564bc689839bc908be22f1/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.133404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:23.152994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2032-bc72-4190-bd4b-6732e7bc8fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e168c5eb0c474ff6909edf8176b354bc, user_id=4c9ce0f831564bc689839bc908be22f1, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.154278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e800c-03d0-41c3-ba4d-652508c043be service glance] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:23.157358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2032-bc72-4190-bd4b-6732e7bc8fad admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.159399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:23.160550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.160905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.161569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] PATH_INFO: `/v3/users/771b3aad28e7402383b970ee1ee8f67e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.163019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] RBAC: Authorizing `identity:delete_user(user_id=771b3aad28e7402383b970ee1ee8f67e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.165650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.179387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1024/2051] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:23 2022] PUT /identity/v3/projects/e168c5eb0c474ff6909edf8176b354bc/users/4c9ce0f831564bc689839bc908be22f1/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:23.184403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.184896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.185251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.195198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:23.210121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:23.213471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:23.243714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771b3aad28e7402383b970ee1ee8f67e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:23.255935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771b3aad28e7402383b970ee1ee8f67e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:23.267560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771b3aad28e7402383b970ee1ee8f67e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:23.279317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771b3aad28e7402383b970ee1ee8f67e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:23.281817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dbea41de-640e-40aa-9ddd-42cc755b454a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771b3aad28e7402383b970ee1ee8f67e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:23.289630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1025/2052] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:23.304943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:23.307107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:23.326784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1028/2053] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:23 2022] DELETE /identity/v3/users/771b3aad28e7402383b970ee1ee8f67e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:23.328872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b45c87-7fe2-43ab-bc2d-6cb8024f3fee None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.329326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b45c87-7fe2-43ab-bc2d-6cb8024f3fee None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.329796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b45c87-7fe2-43ab-bc2d-6cb8024f3fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.339317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:23.360527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b0b45c87-7fe2-43ab-bc2d-6cb8024f3fee None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:23.362127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b0b45c87-7fe2-43ab-bc2d-6cb8024f3fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:23.392437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793fba1-1cb9-4f76-92b3-c063841bb3f7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:23.466074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1029/2054] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:23.480737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b45c87-7fe2-43ab-bc2d-6cb8024f3fee None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:23.537217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:23.537847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.538138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.539101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.561040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.564898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.577790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b45c87-7fe2-43ab-bc2d-6cb8024f3fee None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:23.584328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:23.585244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:23.585722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:23.586350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:23.608104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1026/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:23.622661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:23.628512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:23.663598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1030/2056] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:24.137726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:24.141485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:24.167901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71fff9-735a-4dc2-989a-f7b682f5b8b9 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:24.184037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:24.184753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:24.185039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:24.185472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] PATH_INFO: `/v3/projects/30cbb93c6f5f4f8db5e258469d1bce82` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:24.186997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cbb93c6f5f4f8db5e258469d1bce82)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:24.189216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:24.265444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cbb93c6f5f4f8db5e258469d1bce82', 'request_id': 'req-4a25fe52-6bab-427a-96a3-206f9387494f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.272106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cbb93c6f5f4f8db5e258469d1bce82', 'request_id': 'req-4a25fe52-6bab-427a-96a3-206f9387494f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.274030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:24.289361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cbb93c6f5f4f8db5e258469d1bce82', 'request_id': 'req-4a25fe52-6bab-427a-96a3-206f9387494f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.309380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] The token cache is being invalidate because project 30cbb93c6f5f4f8db5e258469d1bce82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:24.309887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.310846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.312865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1027/2057] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:24 2022] DELETE /identity/v3/projects/30cbb93c6f5f4f8db5e258469d1bce82 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:24.317450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:24.334270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d48ec-021a-436e-8dcd-cc4477ef9f5f service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:24.440457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:24.441124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:24.441411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:24.441717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] PATH_INFO: `/v3/users/c2653015400e41b197e621504b6dafc8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:24.442896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2653015400e41b197e621504b6dafc8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:24.444897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:24.497071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2653015400e41b197e621504b6dafc8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.511625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2653015400e41b197e621504b6dafc8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.514133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:24.523549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2653015400e41b197e621504b6dafc8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.525393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2653015400e41b197e621504b6dafc8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.526294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2653015400e41b197e621504b6dafc8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:24.548170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1031/2058] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:24 2022] DELETE /identity/v3/users/c2653015400e41b197e621504b6dafc8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:24.872976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:24.874484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:24.894318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25fe52-6bab-427a-96a3-206f9387494f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.019984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.021821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:25.040434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.046906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.047197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.047504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] PATH_INFO: `/v3/projects/b0169030f7714e76b48434d9b1b8a903` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.049996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0169030f7714e76b48434d9b1b8a903)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.052920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.178223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0169030f7714e76b48434d9b1b8a903', 'request_id': 'req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.187933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0169030f7714e76b48434d9b1b8a903', 'request_id': 'req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.189552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534b21b-7ce0-49cb-a821-52fc4d67b44f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.207869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0169030f7714e76b48434d9b1b8a903', 'request_id': 'req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.253334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] The token cache is being invalidate because project b0169030f7714e76b48434d9b1b8a903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:25.254526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.257621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e3b0f472-00f2-4d22-adc8-b2ece91c8e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.263016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1028/2059] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:24 2022] DELETE /identity/v3/projects/b0169030f7714e76b48434d9b1b8a903 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:25.268360 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82742d03-649d-48d1-b6f2-6a5dc23647c1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.268650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82742d03-649d-48d1-b6f2-6a5dc23647c1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.268936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82742d03-649d-48d1-b6f2-6a5dc23647c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.302915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-82742d03-649d-48d1-b6f2-6a5dc23647c1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:25.307435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-82742d03-649d-48d1-b6f2-6a5dc23647c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:25.330675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.332511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.332830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.333136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] PATH_INFO: `/v3/users/5ddd599bf30c423cab1d67bc7c2fc437` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.335005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddd599bf30c423cab1d67bc7c2fc437)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.337295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.400294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1029/2060] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:25.411553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be09e-b526-4d9c-9a2f-d6581a960ad9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.412002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be09e-b526-4d9c-9a2f-d6581a960ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.412318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be09e-b526-4d9c-9a2f-d6581a960ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.436770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddd599bf30c423cab1d67bc7c2fc437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.441187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-018be09e-b526-4d9c-9a2f-d6581a960ad9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:25.444362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-018be09e-b526-4d9c-9a2f-d6581a960ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:25.452085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddd599bf30c423cab1d67bc7c2fc437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.459916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1030/2061] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:25.464046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddd599bf30c423cab1d67bc7c2fc437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.465220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018be09e-b526-4d9c-9a2f-d6581a960ad9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.465680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddd599bf30c423cab1d67bc7c2fc437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.467071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-85ab2eea-38df-4602-94c0-4472430c8501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddd599bf30c423cab1d67bc7c2fc437'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:25.479956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018be09e-b526-4d9c-9a2f-d6581a960ad9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.486496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.487771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.488477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.489587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.494782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:25.495966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.510283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.514380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:25.526477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:25.530610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1032/2062] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:25 2022] DELETE /identity/v3/users/5ddd599bf30c423cab1d67bc7c2fc437 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:25.537402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1031/2063] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:19:25.539593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.540045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.540704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.541070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.545074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:25.566625 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd54b-35be-4938-a7e8-1d2c330f91db admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.592707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:25.598620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:25.652529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.653315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.653701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.654349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.655246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.658563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.702270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1032/2064] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:25 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:25.703476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.704611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1033/2065] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:25.715245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.718050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:25.800177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf0314-cf0d-4637-b77a-952962db399f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.808568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.809570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.810076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.810361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.811181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.813118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f019-413e-4df8-9476-e47e2b398c73 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.813400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.854052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1033/2066] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:25 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:25.859475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.877419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963938c-df5b-4147-aeb1-0ba905c1b091 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.884664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.885875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.886203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.886737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.887585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.889495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.890724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.891848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.892137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.892417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.904413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1034/2067] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:19:25.904893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.906416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.915775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.920374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1034/2068] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:25.932215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c365dd-9c8a-44aa-80bb-877dd675b9d4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.939202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb49e4-1a80-4023-8306-256f9b5d2f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.940152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb49e4-1a80-4023-8306-256f9b5d2f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.940664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb49e4-1a80-4023-8306-256f9b5d2f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.941027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb49e4-1a80-4023-8306-256f9b5d2f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:25.941811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb49e4-1a80-4023-8306-256f9b5d2f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:25.944380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb49e4-1a80-4023-8306-256f9b5d2f44 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:25.963672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1035/2069] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:25.967720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:25.982445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fab63-1695-4333-9ea0-77b5b0d2838e service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:25.995789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:25.996480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:25.996765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:25.997387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] PATH_INFO: `/v3/projects/3a8858c0886c4b129fe25d3d6efed651/users/ac4a8d98ebb7425aa8adea124150fafa/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.032209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8858c0886c4b129fe25d3d6efed651, user_id=ac4a8d98ebb7425aa8adea124150fafa, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.038279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.075306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1035/2070] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:25 2022] PUT /identity/v3/projects/3a8858c0886c4b129fe25d3d6efed651/users/ac4a8d98ebb7425aa8adea124150fafa/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:26.089984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.089984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.090233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.134180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] MFA Rules not processed for user `ac4a8d98ebb7425aa8adea124150fafa`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:26.136122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:26.224531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:26.273854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1036/2071] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:26.279027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:26.320986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:26.365985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:26.367594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:26.370612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c58c-67d9-4e92-9ecf-c579c727ab9f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:26.380328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:26.381067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.381417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.381754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.383066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.385874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.386934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d01a93-e261-4d3d-a3f2-a3f2c3266e64 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:26.393537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:26.394196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.394477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.394754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] PATH_INFO: `/v3/projects/1f3b48201a0d4da781c28a3a64890e82` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.395969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3b48201a0d4da781c28a3a64890e82)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.397909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.425316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1036/2072] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:26 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:26.435832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:26.466662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3b48201a0d4da781c28a3a64890e82', 'request_id': 'req-3007a65b-a3b9-4a73-a2b8-a521eff063f5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.474566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3b48201a0d4da781c28a3a64890e82', 'request_id': 'req-3007a65b-a3b9-4a73-a2b8-a521eff063f5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.486113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3b48201a0d4da781c28a3a64890e82', 'request_id': 'req-3007a65b-a3b9-4a73-a2b8-a521eff063f5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.502415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] The token cache is being invalidate because project 1f3b48201a0d4da781c28a3a64890e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:26.502787 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.503723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.505922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1037/2073] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:26 2022] DELETE /identity/v3/projects/1f3b48201a0d4da781c28a3a64890e82 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:26.510523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:26.512894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:26.515320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a2bf-ef25-4318-bc99-f6e9c9396bcb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:26.593270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:26.593909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.594189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.594464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.595136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.600476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.606934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007a65b-a3b9-4a73-a2b8-a521eff063f5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:26.612794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:26.613764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.614455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.614737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] PATH_INFO: `/v3/users/31a0bac2fa204943a6643adb201a7f25` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.616347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a0bac2fa204943a6643adb201a7f25)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.619390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.630893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1037/2074] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:26 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:26.635123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:26.639802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:26.660268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25affc16-bde4-4476-b566-bcec7561410d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:26.667893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:26.669889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.670428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.670842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.671731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.673661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.699103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1038/2075] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:26.704874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:26.719796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a0bac2fa204943a6643adb201a7f25'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.720607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a0bac2fa204943a6643adb201a7f25'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.728996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821dbf-ad90-42aa-b689-fa71c09cff1f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:26.731059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a0bac2fa204943a6643adb201a7f25'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.743317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:26.743975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.744261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.744538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.745397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.747124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.758217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a0bac2fa204943a6643adb201a7f25'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.760420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:26.771168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1039/2076] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:26.772152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:26.775852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b8a82d8d-3759-4b06-a832-e92c08643d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a0bac2fa204943a6643adb201a7f25'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:26.776247 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:26.795684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986812e-10d6-4458-9239-12218186ecb2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:26.802612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:26.803549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.804023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.805177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] PATH_INFO: `/v3/projects/73b2cc63948e48e0b6f4a195108a22bb/users/9910d8583fd64325974cca1c6b8a0700/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.818871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1038/2077] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:26 2022] DELETE /identity/v3/users/31a0bac2fa204943a6643adb201a7f25 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:26.826810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b2cc63948e48e0b6f4a195108a22bb, user_id=9910d8583fd64325974cca1c6b8a0700, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:26.830570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:26.855123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1040/2078] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:26 2022] PUT /identity/v3/projects/73b2cc63948e48e0b6f4a195108a22bb/users/9910d8583fd64325974cca1c6b8a0700/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:26.870331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8c83f-e37b-4987-8010-9219b4c7e125 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:26.872018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8c83f-e37b-4987-8010-9219b4c7e125 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:26.872018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8c83f-e37b-4987-8010-9219b4c7e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:26.944147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-50b8c83f-e37b-4987-8010-9219b4c7e125 None None] MFA Rules not processed for user `9910d8583fd64325974cca1c6b8a0700`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:26.945896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-50b8c83f-e37b-4987-8010-9219b4c7e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:27.070472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1039/2079] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:27.075394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:27.083364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:27.197644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79fa6-388d-4448-bed6-b2fe37f8a8cf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:27.207435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:27.209158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.209565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.209919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.211223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:27.214615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:27.260506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1041/2080] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:27 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:27.261476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8c83f-e37b-4987-8010-9219b4c7e125 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:27.275737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8c83f-e37b-4987-8010-9219b4c7e125 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:27.403890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:27.404801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.405228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.405671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.406556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:27.408805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:27.459500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1040/2081] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:27 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:27.464078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:27.480457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d6a77-34e5-4cdd-ab5d-5eb90ce427b4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:27.485962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:27.486744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.487130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.487545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.489151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:27.491028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:27.511690 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1042/2082] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:27.513616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:27.530701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef771ab0-fb95-432c-ba81-b4761e27ac5c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:27.538335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:27.541409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.542193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.544861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] PATH_INFO: `/v3/projects/566db16afb634b0d973d2b2d12c379ca/users/841a29743d3b49849c2bdd7b840245f6/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.597432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566db16afb634b0d973d2b2d12c379ca, user_id=841a29743d3b49849c2bdd7b840245f6, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:27.601527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:27.643462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:27.643727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1041/2083] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:27 2022] PUT /identity/v3/projects/566db16afb634b0d973d2b2d12c379ca/users/841a29743d3b49849c2bdd7b840245f6/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:27.648183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:27.648990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:27.673659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2287b1-118c-44a6-b0c7-a8f109318db2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:27.718251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:27.791993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b175a1-0c9f-4f24-89d1-f4d5ebea5fe3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:27.803053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:27.803954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.804299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.804734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.805756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:27.807649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:27.821564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1042/2084] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:27.826176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:27.829136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:27.830732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.831030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.831345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] PATH_INFO: `/v3/projects/7c00886902fc444fb7b8c5c086083fa4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.833397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c00886902fc444fb7b8c5c086083fa4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:27.838053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:27.843601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428114c-6e2b-4062-a922-dbf8908528ab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:27.857983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9f1ab-cbb8-4e42-bea2-43d486e72962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:27.859099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f1ab-cbb8-4e42-bea2-43d486e72962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.859536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f1ab-cbb8-4e42-bea2-43d486e72962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.859883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f1ab-cbb8-4e42-bea2-43d486e72962 admin admin] PATH_INFO: `/v3/projects/566db16afb634b0d973d2b2d12c379ca/users/841a29743d3b49849c2bdd7b840245f6/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.862901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9f1ab-cbb8-4e42-bea2-43d486e72962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566db16afb634b0d973d2b2d12c379ca, user_id=841a29743d3b49849c2bdd7b840245f6, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:27.866280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9f1ab-cbb8-4e42-bea2-43d486e72962 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:27.892098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1043/2085] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:27 2022] PUT /identity/v3/projects/566db16afb634b0d973d2b2d12c379ca/users/841a29743d3b49849c2bdd7b840245f6/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:27.903965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.904319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.904525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:27.925991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c00886902fc444fb7b8c5c086083fa4', 'request_id': 'req-7889bfa0-e59f-4549-92e1-392981651bd0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:27.938577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c00886902fc444fb7b8c5c086083fa4', 'request_id': 'req-7889bfa0-e59f-4549-92e1-392981651bd0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:27.947781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] MFA Rules not processed for user `841a29743d3b49849c2bdd7b840245f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:27.949871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:27.949996 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c00886902fc444fb7b8c5c086083fa4', 'request_id': 'req-7889bfa0-e59f-4549-92e1-392981651bd0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:27.979808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] The token cache is being invalidate because project 7c00886902fc444fb7b8c5c086083fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:27.980109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:27.981077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7889bfa0-e59f-4549-92e1-392981651bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:27.986933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1043/2086] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:27 2022] DELETE /identity/v3/projects/7c00886902fc444fb7b8c5c086083fa4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:27.988364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e2013-d2cd-44c2-8629-dda495b464d0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:27.988661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e2013-d2cd-44c2-8629-dda495b464d0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:27.988944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e2013-d2cd-44c2-8629-dda495b464d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.041273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-469e2013-d2cd-44c2-8629-dda495b464d0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:28.047629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-469e2013-d2cd-44c2-8629-dda495b464d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:28.054060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:28.081090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1044/2087] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:28.097312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.100521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:28.199413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1044/2088] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:28.208172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5bfee-0e9f-47c5-9ffc-d87189739851 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.208771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5bfee-0e9f-47c5-9ffc-d87189739851 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.209061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5bfee-0e9f-47c5-9ffc-d87189739851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.221010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3aba-83ea-49db-b5d1-87713152edea None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.235760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.236688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.236967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.237242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.251023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b9e5bfee-0e9f-47c5-9ffc-d87189739851 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:28.252295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9e5bfee-0e9f-47c5-9ffc-d87189739851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:28.258711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.260374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.279041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1045/2089] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:28.279979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.280777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1045/2090] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:28.305239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e52e74-9499-47cb-b806-6ca97d99701e service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.325665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.326692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.333127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.334838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.339427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:28.340227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.344734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.421322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1046/2091] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:28.440619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5bfee-0e9f-47c5-9ffc-d87189739851 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.447204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.456162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5bfee-0e9f-47c5-9ffc-d87189739851 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.462913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab3177-26f4-4032-aae7-d04063b6ca8f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.464839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.465791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.466604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.467049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.468512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.473774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.476761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.478532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.479488 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.480903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.486699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:28.519606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1046/2092] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:28 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:28.543686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.598727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:28.671000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.674637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.698659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1047/2093] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:28.709028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031cb29-47da-476b-ac36-462efc29a261 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.714418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.715129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.715515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.715858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.716601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.719525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.778539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1047/2094] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:28 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:28.782959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.802215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4358e-dda6-4f98-b20c-6f9dee4a2901 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.810195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.811190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.811611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.811899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.812826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.814458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.832359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1048/2095] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:19:28.837945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.849274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ea9c7-ec97-4b12-ba46-976f48beb3d0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.860688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882624b8-3da4-4d87-a722-faa96cb9aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.862137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882624b8-3da4-4d87-a722-faa96cb9aac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.862641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882624b8-3da4-4d87-a722-faa96cb9aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.863440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882624b8-3da4-4d87-a722-faa96cb9aac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.864362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882624b8-3da4-4d87-a722-faa96cb9aac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.867109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882624b8-3da4-4d87-a722-faa96cb9aac9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.887513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1048/2096] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:19:28.891718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:28.906372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13dba-24cc-4761-90f9-d667853b41b2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:28.911914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:28.913178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.913472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.913755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] PATH_INFO: `/v3/projects/03437cff78b34422bf217197107d5b01/users/350dcb128df84541a2d9d2ba03ae194c/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:28.933373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03437cff78b34422bf217197107d5b01, user_id=350dcb128df84541a2d9d2ba03ae194c, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:28.937006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:28.967256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1049/2097] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:28 2022] PUT /identity/v3/projects/03437cff78b34422bf217197107d5b01/users/350dcb128df84541a2d9d2ba03ae194c/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:28.979305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227a470-5759-4fc3-a560-8d4230373164 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:28.979305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227a470-5759-4fc3-a560-8d4230373164 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:28.979611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227a470-5759-4fc3-a560-8d4230373164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.065696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b227a470-5759-4fc3-a560-8d4230373164 None None] MFA Rules not processed for user `350dcb128df84541a2d9d2ba03ae194c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:29.067551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b227a470-5759-4fc3-a560-8d4230373164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:29.128399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:29.164472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1049/2098] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:29.178970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:29.333561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c4c1e-e832-405e-a14a-e01f5d6635d4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:29.339879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:29.341893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.343681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.344028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.344890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:29.347314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:29.394604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227a470-5759-4fc3-a560-8d4230373164 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:29.395222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1050/2099] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:29 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:29.420565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227a470-5759-4fc3-a560-8d4230373164 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:29.530679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee1cbe-f6cc-4e73-8cdb-1edf631b32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:29.531343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1cbe-f6cc-4e73-8cdb-1edf631b32a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.531736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1cbe-f6cc-4e73-8cdb-1edf631b32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.532089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1cbe-f6cc-4e73-8cdb-1edf631b32a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.533097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee1cbe-f6cc-4e73-8cdb-1edf631b32a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:29.535181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee1cbe-f6cc-4e73-8cdb-1edf631b32a6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:29.573276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:29.585861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1050/2100] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:29 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:29.589648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49de182-3566-4765-89ac-535e93989d23 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:29.600768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8703-447c-4128-b5c5-1e93f4923beb None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.601130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8703-447c-4128-b5c5-1e93f4923beb None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.601368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8703-447c-4128-b5c5-1e93f4923beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.624324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:29.626690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.629714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.630054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.631209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:29.632753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:29.646056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dc5a8703-447c-4128-b5c5-1e93f4923beb None None] MFA Rules not processed for user `4c9ce0f831564bc689839bc908be22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:29.647507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dc5a8703-447c-4128-b5c5-1e93f4923beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:29.647638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1051/2101] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:29.651799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:29.668746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7d2d2-fbce-43e9-9334-33328f495168 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:29.675721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:29.676831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.677771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.678263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] PATH_INFO: `/v3/projects/dc5d9522e0dd4e5a9737da57761ceb58/users/4941ed5a096142a1b61ab4d1989c20a8/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.697519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5d9522e0dd4e5a9737da57761ceb58, user_id=4941ed5a096142a1b61ab4d1989c20a8, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:29.700336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:29.717680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1052/2102] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:29 2022] PUT /identity/v3/projects/dc5d9522e0dd4e5a9737da57761ceb58/users/4941ed5a096142a1b61ab4d1989c20a8/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:29.722200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:29.738625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1051/2103] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:29.751088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.751410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.751716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.773584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] MFA Rules not processed for user `4c9ce0f831564bc689839bc908be22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:29.774845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:29.791713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:29.813396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eee15-0ce9-4833-a590-48a082e0ccb1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:29.822190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:29.823089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.823617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.824631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.825343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:29.826962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:29.843463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1053/2104] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:29.844507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:29.858507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcff433-1749-42af-8a6c-ff123bf24bde admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:29.863599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686221e-8fc1-41bd-883f-683b5281ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:29.864372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686221e-8fc1-41bd-883f-683b5281ea12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.864649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686221e-8fc1-41bd-883f-683b5281ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.865002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686221e-8fc1-41bd-883f-683b5281ea12 admin admin] PATH_INFO: `/v3/projects/dc5d9522e0dd4e5a9737da57761ceb58/users/4941ed5a096142a1b61ab4d1989c20a8/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.865492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1052/2105] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:29.866876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686221e-8fc1-41bd-883f-683b5281ea12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5d9522e0dd4e5a9737da57761ceb58, user_id=4941ed5a096142a1b61ab4d1989c20a8, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:29.869949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686221e-8fc1-41bd-883f-683b5281ea12 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:29.880384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:29.882190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:29.882867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1054/2106] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:29 2022] PUT /identity/v3/projects/dc5d9522e0dd4e5a9737da57761ceb58/users/4941ed5a096142a1b61ab4d1989c20a8/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:29.895700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:29.895992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:29.896288 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:29.929578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:29.941272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] MFA Rules not processed for user `4941ed5a096142a1b61ab4d1989c20a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:29.942815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:29.994384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6f2f1-6d74-46a4-b3cc-77202e6b5111 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:30.048334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1055/2107] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:30.056954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:30.058366 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:30.081780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:30.082493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:30.082781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:30.083062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:30.185475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693fe6c-c2e3-41c0-aaad-20d3574ebf3b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:30.188824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:30.190568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:30.193741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2e93a-1fb6-435f-9837-90910f4cfdf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:30.201147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1053/2108] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:30.204026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e93a-1fb6-435f-9837-90910f4cfdf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:30.204634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e93a-1fb6-435f-9837-90910f4cfdf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:30.204739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e93a-1fb6-435f-9837-90910f4cfdf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:30.218570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2e93a-1fb6-435f-9837-90910f4cfdf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:30.220292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2e93a-1fb6-435f-9837-90910f4cfdf1 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:30.232560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1056/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:30.825794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:30.911426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:30.934476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc96669-9164-45a4-a6d6-d48eeb51f762 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:30.941256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:30.942131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:30.942417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:30.942698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] PATH_INFO: `/v3/users/350dcb128df84541a2d9d2ba03ae194c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:30.944227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350dcb128df84541a2d9d2ba03ae194c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:30.948593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:31.015737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350dcb128df84541a2d9d2ba03ae194c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:31.028771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350dcb128df84541a2d9d2ba03ae194c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:31.039631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350dcb128df84541a2d9d2ba03ae194c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:31.040682 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350dcb128df84541a2d9d2ba03ae194c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:31.041581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-60cbcf03-3a24-4326-9107-666d823c9ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350dcb128df84541a2d9d2ba03ae194c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:31.088950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1054/2110] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:30 2022] DELETE /identity/v3/users/350dcb128df84541a2d9d2ba03ae194c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:31.090876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb51df-e406-417f-b97d-248302711089 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:31.091441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb51df-e406-417f-b97d-248302711089 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:31.091532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb51df-e406-417f-b97d-248302711089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:31.123034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2feb51df-e406-417f-b97d-248302711089 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:31.123034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2feb51df-e406-417f-b97d-248302711089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:31.130409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:31.130865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:31.131394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:31.153515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] MFA Rules not processed for user `4c9ce0f831564bc689839bc908be22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:31.155083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:31.236034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:31.246090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1057/2111] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:31.258027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb51df-e406-417f-b97d-248302711089 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:31.260840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2feb51df-e406-417f-b97d-248302711089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:31.265150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1055/2112] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:31.387816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb51df-e406-417f-b97d-248302711089 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:31.401318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:31.401963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:31.403541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:31.404414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:31.425776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:31.427283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:31.512708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1058/2113] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:32.040983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:32.047656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:32.074185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb305b28-5408-471c-9a1c-db8bf2314576 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:32.081031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:32.081589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:32.081941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:32.082232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] PATH_INFO: `/v3/projects/03437cff78b34422bf217197107d5b01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:32.084049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03437cff78b34422bf217197107d5b01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:32.089594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:32.174928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03437cff78b34422bf217197107d5b01', 'request_id': 'req-b11120d4-6b81-4783-a67c-6075bca51356'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.183791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:32.186314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:32.193614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03437cff78b34422bf217197107d5b01', 'request_id': 'req-b11120d4-6b81-4783-a67c-6075bca51356'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.204388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03437cff78b34422bf217197107d5b01', 'request_id': 'req-b11120d4-6b81-4783-a67c-6075bca51356'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.216675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb40f14-bb06-497e-932c-6c5b97fd17cf service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:32.216991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:32.239297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] The token cache is being invalidate because project 03437cff78b34422bf217197107d5b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:32.239297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.243207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.248034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1056/2114] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:32 2022] DELETE /identity/v3/projects/03437cff78b34422bf217197107d5b01 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:32.252917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:32.255462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:32.335400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:32.335731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:32.335870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:32.336737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] PATH_INFO: `/v3/users/ac4a8d98ebb7425aa8adea124150fafa` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:32.338099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4a8d98ebb7425aa8adea124150fafa)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:32.340478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:32.368568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11120d4-6b81-4783-a67c-6075bca51356 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:32.374522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:32.375208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:32.375598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:32.375872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] PATH_INFO: `/v3/users/4941ed5a096142a1b61ab4d1989c20a8` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:32.377311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4941ed5a096142a1b61ab4d1989c20a8)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:32.379250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:32.434147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4a8d98ebb7425aa8adea124150fafa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.434886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4a8d98ebb7425aa8adea124150fafa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.435571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4a8d98ebb7425aa8adea124150fafa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.453410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4a8d98ebb7425aa8adea124150fafa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.456115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4941ed5a096142a1b61ab4d1989c20a8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.464065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-65d3f47c-5acf-4f65-bded-e052745ed975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4a8d98ebb7425aa8adea124150fafa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.467839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4941ed5a096142a1b61ab4d1989c20a8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.478587 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4941ed5a096142a1b61ab4d1989c20a8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.479490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4941ed5a096142a1b61ab4d1989c20a8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.480153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4941ed5a096142a1b61ab4d1989c20a8'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:32.484863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1059/2115] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:32 2022] DELETE /identity/v3/users/ac4a8d98ebb7425aa8adea124150fafa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:32.489195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:32.489801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:32.490003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:32.500946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1057/2116] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:32 2022] DELETE /identity/v3/users/4941ed5a096142a1b61ab4d1989c20a8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:32.512336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:32.513666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:32.542067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:32.638426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1060/2117] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:32.693382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:32.695000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:32.794204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec806f-e168-419a-9702-2c2fac90d3dd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:32.798149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989477f3-7e84-4753-afcc-8dec8aba693f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:32.798717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989477f3-7e84-4753-afcc-8dec8aba693f service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:32.799014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989477f3-7e84-4753-afcc-8dec8aba693f service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:32.799442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989477f3-7e84-4753-afcc-8dec8aba693f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:32.818291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989477f3-7e84-4753-afcc-8dec8aba693f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:32.821752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989477f3-7e84-4753-afcc-8dec8aba693f service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:32.856501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1058/2118] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:33.155978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:33.157456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:33.172455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f96af-3cff-47cc-be55-e761cf4759c7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:33.177259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:33.177905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:33.178187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:33.178466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] PATH_INFO: `/v3/projects/dc5d9522e0dd4e5a9737da57761ceb58` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:33.180272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5d9522e0dd4e5a9737da57761ceb58)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:33.181806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:33.250662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5d9522e0dd4e5a9737da57761ceb58', 'request_id': 'req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.268089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5d9522e0dd4e5a9737da57761ceb58', 'request_id': 'req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.283361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5d9522e0dd4e5a9737da57761ceb58', 'request_id': 'req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.302352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] The token cache is being invalidate because project dc5d9522e0dd4e5a9737da57761ceb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:33.302904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.303843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.308969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1061/2119] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:33 2022] DELETE /identity/v3/projects/dc5d9522e0dd4e5a9737da57761ceb58 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:33.313830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb42e-0152-4eea-b4b3-807dc43baf3c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:33.314892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb42e-0152-4eea-b4b3-807dc43baf3c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:33.315578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb42e-0152-4eea-b4b3-807dc43baf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:33.358127 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b1fcb42e-0152-4eea-b4b3-807dc43baf3c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:33.360554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b1fcb42e-0152-4eea-b4b3-807dc43baf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:33.418129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:33.489683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:33.503067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:33.596713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1059/2120] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:33.605255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889b9f-2792-42ea-a988-76af9fd18cf5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:33.605612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889b9f-2792-42ea-a988-76af9fd18cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:33.606418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889b9f-2792-42ea-a988-76af9fd18cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:33.645675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0029f6-ee98-4afc-9b92-cbabd53d25aa admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:33.657072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:33.657745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:33.658325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:33.658856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] PATH_INFO: `/v3/projects/3a8858c0886c4b129fe25d3d6efed651` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:33.660496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8858c0886c4b129fe25d3d6efed651)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:33.663051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:33.668115 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f1889b9f-2792-42ea-a988-76af9fd18cf5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:33.669618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f1889b9f-2792-42ea-a988-76af9fd18cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:33.681614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1060/2121] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:33.687150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1889b9f-2792-42ea-a988-76af9fd18cf5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:33.719094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1889b9f-2792-42ea-a988-76af9fd18cf5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:33.761384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:33.762089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:33.762347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:33.762645 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:33.763339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:33.763642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:33.765295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:33.789082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1061/2122] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:33.793720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:33.799141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:33.801560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8858c0886c4b129fe25d3d6efed651', 'request_id': 'req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.815688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8858c0886c4b129fe25d3d6efed651', 'request_id': 'req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.817918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40016df0-dfe0-49e2-9bb6-3e5bdd256a6c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:33.830964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8858c0886c4b129fe25d3d6efed651', 'request_id': 'req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.849318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] The token cache is being invalidate because project 3a8858c0886c4b129fe25d3d6efed651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:33.849744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.850565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:33.852920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1062/2123] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:33 2022] DELETE /identity/v3/projects/3a8858c0886c4b129fe25d3d6efed651 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:33.857335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:33.859533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:33.952437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:33.953802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:33.955132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:33.956662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:33.957553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:33.962369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:33.987456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ba51e-7f7e-4ebc-a5da-d498c8270bc6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:33.992834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:33.993386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:33.993946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:33.993946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] PATH_INFO: `/v3/users/9910d8583fd64325974cca1c6b8a0700` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:33.996159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9910d8583fd64325974cca1c6b8a0700)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:34.003661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:34.010807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1062/2124] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:33 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:34.012779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:34.019629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:34.098384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9910d8583fd64325974cca1c6b8a0700'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:34.099637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9910d8583fd64325974cca1c6b8a0700'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:34.103488 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9910d8583fd64325974cca1c6b8a0700'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:34.138259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9910d8583fd64325974cca1c6b8a0700'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:34.147826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9910d8583fd64325974cca1c6b8a0700'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:34.165901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1534-1b55-4520-8dc3-74760ee7377c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:34.172433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:34.173066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:34.173376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1063/2125] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:33 2022] DELETE /identity/v3/users/9910d8583fd64325974cca1c6b8a0700 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:34.173625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:34.174652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:34.175859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:34.186759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:34.234547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1063/2126] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:34 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:34.238744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:34.240494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:34.326926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:34.345252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b58a-e0bf-46f6-8b05-8d0fb68a5b70 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:34.354135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:34.355948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:34.356442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:34.356958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:34.358220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:34.361145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:34.378060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1064/2127] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:34.382010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:34.397228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17efa5e-4d90-4c64-8071-88831aeb9c31 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:34.407005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f439bf7-2341-4956-af65-c57c533d2d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:34.408301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f439bf7-2341-4956-af65-c57c533d2d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:34.411629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f439bf7-2341-4956-af65-c57c533d2d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:34.413326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f439bf7-2341-4956-af65-c57c533d2d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:34.414184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f439bf7-2341-4956-af65-c57c533d2d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:34.421431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f439bf7-2341-4956-af65-c57c533d2d38 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:34.436439 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1064/2128] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:34.441475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:34.469269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97afc4-e055-4d52-ab1f-d937a28c9e90 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:34.476148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:34.477486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:34.477878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:34.478226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] PATH_INFO: `/v3/projects/55c335d937424964ba4e858346c6610d/users/0205970be73c4b949ab36a193db6eed7/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:34.524166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c335d937424964ba4e858346c6610d, user_id=0205970be73c4b949ab36a193db6eed7, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:34.528185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:34.576458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1065/2129] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:34 2022] PUT /identity/v3/projects/55c335d937424964ba4e858346c6610d/users/0205970be73c4b949ab36a193db6eed7/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:34.587866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:34.590654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:34.590879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:34.604662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:34.622035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:34.623490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:34.678669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:34.681673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:34.785615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1065/2130] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:34.799321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:34.801082 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:34.943241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369081b-018c-4482-821c-2c4a63dc7fef admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:34.953054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:34.953848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:34.954201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:34.954566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] PATH_INFO: `/v3/projects/73b2cc63948e48e0b6f4a195108a22bb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:34.955871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b2cc63948e48e0b6f4a195108a22bb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:34.958241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:35.016206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5f5f-93c7-494b-8a00-52f01b72bd92 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:35.030473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b2cc63948e48e0b6f4a195108a22bb', 'request_id': 'req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.039720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b2cc63948e48e0b6f4a195108a22bb', 'request_id': 'req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.061371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b2cc63948e48e0b6f4a195108a22bb', 'request_id': 'req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.105541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] The token cache is being invalidate because project 73b2cc63948e48e0b6f4a195108a22bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:35.107153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.112567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.119413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1066/2131] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:34 2022] DELETE /identity/v3/projects/73b2cc63948e48e0b6f4a195108a22bb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:35.124421 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:35.127297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:35.170529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:35.171291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:35.171575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:35.171872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:35.181829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:35.272341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:35.274611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:35.287102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1066/2132] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:35.341134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:35.347605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e4d7f-9c4a-4ebc-9f8d-c5485d421478 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:35.356234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:35.364241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:35.364241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:35.364241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] PATH_INFO: `/v3/users/841a29743d3b49849c2bdd7b840245f6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:35.364241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841a29743d3b49849c2bdd7b840245f6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:35.364241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:35.496480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841a29743d3b49849c2bdd7b840245f6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.498174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841a29743d3b49849c2bdd7b840245f6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.499371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841a29743d3b49849c2bdd7b840245f6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.535834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841a29743d3b49849c2bdd7b840245f6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.551079 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-06149383-9152-42c3-b651-e48d035d4dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841a29743d3b49849c2bdd7b840245f6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:35.581429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1067/2133] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:35 2022] DELETE /identity/v3/users/841a29743d3b49849c2bdd7b840245f6 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:36.527172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:36.575713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0bc69-d41c-4d09-a0d7-7e8351bb6ad2 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:36.589521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:36.704360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:36.705066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:36.705377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:36.705661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] PATH_INFO: `/v3/projects/566db16afb634b0d973d2b2d12c379ca` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:36.706938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=566db16afb634b0d973d2b2d12c379ca)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:36.709251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:36.783436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566db16afb634b0d973d2b2d12c379ca', 'request_id': 'req-00eebd82-0934-4b4d-abd8-48eda100a8cb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:36.796726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566db16afb634b0d973d2b2d12c379ca', 'request_id': 'req-00eebd82-0934-4b4d-abd8-48eda100a8cb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:36.809432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566db16afb634b0d973d2b2d12c379ca', 'request_id': 'req-00eebd82-0934-4b4d-abd8-48eda100a8cb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:36.832347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] The token cache is being invalidate because project 566db16afb634b0d973d2b2d12c379ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:36.833890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:36.835146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-00eebd82-0934-4b4d-abd8-48eda100a8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:36.844720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1067/2134] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:36 2022] DELETE /identity/v3/projects/566db16afb634b0d973d2b2d12c379ca => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:36.846236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719dd6-557b-477a-b399-bc41a7006a6e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:36.846902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719dd6-557b-477a-b399-bc41a7006a6e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:36.847243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719dd6-557b-477a-b399-bc41a7006a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:36.877123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c3719dd6-557b-477a-b399-bc41a7006a6e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:36.878364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c3719dd6-557b-477a-b399-bc41a7006a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:36.959610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1068/2135] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:36.961976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d60c-7325-4e42-9339-2e391b864087 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:36.962261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d60c-7325-4e42-9339-2e391b864087 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:36.962535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d60c-7325-4e42-9339-2e391b864087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:36.985757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d9b9d60c-7325-4e42-9339-2e391b864087 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:36.986958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d9b9d60c-7325-4e42-9339-2e391b864087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:36.995469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1068/2136] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:36.999857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3719dd6-557b-477a-b399-bc41a7006a6e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.011786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3719dd6-557b-477a-b399-bc41a7006a6e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:37.018654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:37.019517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.019804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.020696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.021542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:37.022049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:37.024127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:37.043322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1069/2137] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:37.046192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9d60c-7325-4e42-9339-2e391b864087 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.058484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9d60c-7325-4e42-9339-2e391b864087 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:37.065150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:37.066071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.066570 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.067248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.068910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:37.072267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:37.119069 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1069/2138] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:37 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:37.123639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.137298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e784e1b-6265-48a2-ae36-1c0bc6afa1d0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:37.218090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:37.219032 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.219607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.220115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.220992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:37.224472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:37.244807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:37.266610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1070/2139] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:37 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:37.267711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.285822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caa4de-7b0b-4798-bd5f-e885db26a9d1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:37.295438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:37.296083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.296453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.296816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.297585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:37.299862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:37.317519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1070/2140] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:37.319072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.340710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09dfd-8088-43c6-bc36-a4a7fe23bdd1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:37.348382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285b37-ddbb-401b-8248-4f4c94d92f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:37.349140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285b37-ddbb-401b-8248-4f4c94d92f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.349486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285b37-ddbb-401b-8248-4f4c94d92f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.350407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285b37-ddbb-401b-8248-4f4c94d92f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.351313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285b37-ddbb-401b-8248-4f4c94d92f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:37.354064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285b37-ddbb-401b-8248-4f4c94d92f52 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:37.369971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1071/2141] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:37.374834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.386187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda88bf-cc57-467e-97c3-a8ad9f73cfa9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:37.391873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6fb21-2ba3-467d-b2fe-94b2612cdba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:37.392791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6fb21-2ba3-467d-b2fe-94b2612cdba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.393238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6fb21-2ba3-467d-b2fe-94b2612cdba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.393668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6fb21-2ba3-467d-b2fe-94b2612cdba7 admin admin] PATH_INFO: `/v3/projects/0460fe67757143b5b1908d7beaafab54/users/7081a936e1ef4befa8a4a4f07ba949d3/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.415945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6fb21-2ba3-467d-b2fe-94b2612cdba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0460fe67757143b5b1908d7beaafab54, user_id=7081a936e1ef4befa8a4a4f07ba949d3, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:37.418917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6fb21-2ba3-467d-b2fe-94b2612cdba7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:37.463654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1071/2142] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:37 2022] PUT /identity/v3/projects/0460fe67757143b5b1908d7beaafab54/users/7081a936e1ef4befa8a4a4f07ba949d3/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:37.531888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2c70-287c-4da7-ac92-87187f22d7e6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.532681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2c70-287c-4da7-ac92-87187f22d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.533192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2c70-287c-4da7-ac92-87187f22d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.570069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f0ce2c70-287c-4da7-ac92-87187f22d7e6 None None] MFA Rules not processed for user `7081a936e1ef4befa8a4a4f07ba949d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:37.571717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f0ce2c70-287c-4da7-ac92-87187f22d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:37.635437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.636299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.636731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.678229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] MFA Rules not processed for user `0205970be73c4b949ab36a193db6eed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:37.685458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:37.689142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1072/2143] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:37.695191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce2c70-287c-4da7-ac92-87187f22d7e6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.756914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:37.817629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce2c70-287c-4da7-ac92-87187f22d7e6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:37.827935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:37.828640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:37.828928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:37.829489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:37.830223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:37.832992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:37.843053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1072/2144] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:37.861469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.863172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:37.895977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1073/2145] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:37 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:37.899759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:37.995474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f4ac-fd0d-40e7-a988-af5e67335b80 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.045918 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:38.051134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25ecb9-33da-42af-a2dc-9e055c8e932d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.062755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.063737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.064259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.064645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.065514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.068066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.076655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.077327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.077601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.078204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.103633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1074/2146] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:37 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:38.107470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:38.124380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73e83-bff4-4f6f-af68-5c3bfcd20045 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.130153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.130896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.131184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.131496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.132207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.135552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.148143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1075/2147] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:38.152155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:38.156527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.158070 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.171872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e736a4-5bcb-4ef9-8a80-2a3d0af7b4b3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.176975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.177876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.178140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.178387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] PATH_INFO: `/v3/projects/056fa05b9cc04f9a8d53a2c34afb066f/users/cf42be06508948f0b46a7f4f16b177b6/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.183419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1073/2148] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:38.197250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056fa05b9cc04f9a8d53a2c34afb066f, user_id=cf42be06508948f0b46a7f4f16b177b6, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.200980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.221179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1076/2149] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:38 2022] PUT /identity/v3/projects/056fa05b9cc04f9a8d53a2c34afb066f/users/cf42be06508948f0b46a7f4f16b177b6/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:38.225638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:38.242741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438424d-be31-4b9b-ab37-02e7c0f34b03 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.335035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:38.422860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f53d5-aa82-4c28-ad40-8d7a694d851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.423524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f53d5-aa82-4c28-ad40-8d7a694d851f admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.423875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f53d5-aa82-4c28-ad40-8d7a694d851f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.424158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f53d5-aa82-4c28-ad40-8d7a694d851f admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.424843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f53d5-aa82-4c28-ad40-8d7a694d851f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.426632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f53d5-aa82-4c28-ad40-8d7a694d851f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.438224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1074/2150] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:38.444694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:38.458696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1a43-b109-41f5-8ee6-474ab20a1f89 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.464248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.465132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.465480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.465760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] PATH_INFO: `/v3/projects/056fa05b9cc04f9a8d53a2c34afb066f/users/cf42be06508948f0b46a7f4f16b177b6/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.468011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056fa05b9cc04f9a8d53a2c34afb066f, user_id=cf42be06508948f0b46a7f4f16b177b6, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.470685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.481435 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1077/2151] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:38 2022] PUT /identity/v3/projects/056fa05b9cc04f9a8d53a2c34afb066f/users/cf42be06508948f0b46a7f4f16b177b6/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:38.492417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4a7b-dfc8-4983-b8d1-86e5d01cfc1c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.492798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4a7b-dfc8-4983-b8d1-86e5d01cfc1c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.493217 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4a7b-dfc8-4983-b8d1-86e5d01cfc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.525442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-736d4a7b-dfc8-4983-b8d1-86e5d01cfc1c None None] MFA Rules not processed for user `cf42be06508948f0b46a7f4f16b177b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:38.526669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-736d4a7b-dfc8-4983-b8d1-86e5d01cfc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:38.612779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1075/2152] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:38.626095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:38.683660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540669b-7eb2-4aec-abe3-11c45ae62836 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.687171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.687818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.688101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.688379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.697405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.698846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.708321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1078/2153] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:38.787685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4a7b-dfc8-4983-b8d1-86e5d01cfc1c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:38.798474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4a7b-dfc8-4983-b8d1-86e5d01cfc1c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:38.802045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30df848-1b26-4496-aa77-a8a74fe30429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:38.802658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df848-1b26-4496-aa77-a8a74fe30429 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:38.802935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df848-1b26-4496-aa77-a8a74fe30429 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:38.803205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30df848-1b26-4496-aa77-a8a74fe30429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:38.864185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30df848-1b26-4496-aa77-a8a74fe30429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:38.865814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30df848-1b26-4496-aa77-a8a74fe30429 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:38.879143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1076/2154] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:39.145357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:39.211002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa402-8dde-492d-92f2-f6f307825cd2 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:39.215582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:39.216203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:39.216486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:39.216763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] PATH_INFO: `/v3/users/7081a936e1ef4befa8a4a4f07ba949d3` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:39.217950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7081a936e1ef4befa8a4a4f07ba949d3)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:39.219937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:39.264100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:39.267158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7081a936e1ef4befa8a4a4f07ba949d3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.268067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7081a936e1ef4befa8a4a4f07ba949d3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.269159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7081a936e1ef4befa8a4a4f07ba949d3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.282840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7081a936e1ef4befa8a4a4f07ba949d3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.290249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7081a936e1ef4befa8a4a4f07ba949d3'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.302516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1079/2155] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:39 2022] DELETE /identity/v3/users/7081a936e1ef4befa8a4a4f07ba949d3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:39.307798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecaa74-9534-49bc-ad54-05aede94a3ef None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:39.308120 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecaa74-9534-49bc-ad54-05aede94a3ef None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:39.308402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecaa74-9534-49bc-ad54-05aede94a3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:39.327668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-20ecaa74-9534-49bc-ad54-05aede94a3ef None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:39.329036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-20ecaa74-9534-49bc-ad54-05aede94a3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:39.378032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:39.390090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1077/2156] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:39.400375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:39.401837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:39.460776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39e49-1cf8-4a14-bfa8-2137d58770f1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:39.464536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:39.465243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:39.465676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:39.466016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:39.477114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:39.478777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:39.489770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1080/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:39.662631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a055-676c-4772-b491-63ae3998303d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:39.662920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a055-676c-4772-b491-63ae3998303d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:39.663195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a055-676c-4772-b491-63ae3998303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:39.710897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-60a5a055-676c-4772-b491-63ae3998303d None None] MFA Rules not processed for user `0205970be73c4b949ab36a193db6eed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:39.712710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-60a5a055-676c-4772-b491-63ae3998303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:39.797139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:39.798652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:39.819436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f501a-3c0c-404b-a12a-a60737facf40 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:39.825185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1078/2158] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:39.845655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:39.846324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:39.846606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:39.846882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] PATH_INFO: `/v3/projects/0460fe67757143b5b1908d7beaafab54` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:39.848445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0460fe67757143b5b1908d7beaafab54)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:39.850951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:39.935938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0460fe67757143b5b1908d7beaafab54', 'request_id': 'req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.949157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0460fe67757143b5b1908d7beaafab54', 'request_id': 'req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.966491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0460fe67757143b5b1908d7beaafab54', 'request_id': 'req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.984047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] The token cache is being invalidate because project 0460fe67757143b5b1908d7beaafab54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:39.984347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.985052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:39.987034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1081/2159] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:39 2022] DELETE /identity/v3/projects/0460fe67757143b5b1908d7beaafab54 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:39.993275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a055-676c-4772-b491-63ae3998303d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:40.005726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a055-676c-4772-b491-63ae3998303d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:40.097526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:40.098336 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:40.098634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:40.098917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] PATH_INFO: `/v3/users/cf42be06508948f0b46a7f4f16b177b6` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:40.101369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf42be06508948f0b46a7f4f16b177b6)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:40.104134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:40.175824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf42be06508948f0b46a7f4f16b177b6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.185249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf42be06508948f0b46a7f4f16b177b6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.196102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf42be06508948f0b46a7f4f16b177b6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.196840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf42be06508948f0b46a7f4f16b177b6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.197709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1f98a949-cfe5-4ca8-aaa2-0fe45f48d2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf42be06508948f0b46a7f4f16b177b6'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.221704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1079/2160] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:39 2022] DELETE /identity/v3/users/cf42be06508948f0b46a7f4f16b177b6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:40.551481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:40.555564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:40.577181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3595d-fa12-4c3b-9512-f5f1c4f314e7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:40.636906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:40.657117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:40.657871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:40.658137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:40.658614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] PATH_INFO: `/v3/projects/056fa05b9cc04f9a8d53a2c34afb066f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:40.660204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=056fa05b9cc04f9a8d53a2c34afb066f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:40.662317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:40.731906 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056fa05b9cc04f9a8d53a2c34afb066f', 'request_id': 'req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.738422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056fa05b9cc04f9a8d53a2c34afb066f', 'request_id': 'req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.749790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056fa05b9cc04f9a8d53a2c34afb066f', 'request_id': 'req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.764595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] The token cache is being invalidate because project 056fa05b9cc04f9a8d53a2c34afb066f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:40.764883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.765611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-5fc6b7fc-98ae-44f6-9601-b2db3a598d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:40.767340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1082/2161] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:40 2022] DELETE /identity/v3/projects/056fa05b9cc04f9a8d53a2c34afb066f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:40.772651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b851-d302-435d-ac11-c3909b5c126f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:40.772971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b851-d302-435d-ac11-c3909b5c126f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:40.773251 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b851-d302-435d-ac11-c3909b5c126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:40.795581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-09e0b851-d302-435d-ac11-c3909b5c126f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:40.796788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-09e0b851-d302-435d-ac11-c3909b5c126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:40.814144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:40.882709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1080/2162] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:40.884600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5906-c2d8-41c4-9bef-73fe110634b0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:40.884845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5906-c2d8-41c4-9bef-73fe110634b0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:40.884955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5906-c2d8-41c4-9bef-73fe110634b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:40.906913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e4ee5906-c2d8-41c4-9bef-73fe110634b0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:40.908297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e4ee5906-c2d8-41c4-9bef-73fe110634b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:40.917600 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1083/2163] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:40.921750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0b851-d302-435d-ac11-c3909b5c126f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:40.933190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0b851-d302-435d-ac11-c3909b5c126f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:40.938189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:40.938819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:40.939104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:40.939423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:40.940153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:40.940506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:40.942142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:40.954600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1081/2164] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:40.958986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5906-c2d8-41c4-9bef-73fe110634b0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:40.969184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5906-c2d8-41c4-9bef-73fe110634b0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:40.975087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:40.975828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:40.976129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:40.977221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:40.977876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:40.979916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:41.012751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1084/2165] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:40 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:41.017693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:41.029730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db793dd3-6060-40c1-9fbc-121bb62425e7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:41.098430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:41.099055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.099373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.099655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.100331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:41.102362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:41.125253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1082/2166] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:41 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:41.129461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:41.140547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6970bde-3a1d-4cff-9924-2963ff040de4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:41.145489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:41.146104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.146386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.146673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.147391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:41.149074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:41.159739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1085/2167] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:41.163716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:41.174572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2491-6ea3-4b5a-96a7-982dd1b76d84 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:41.180396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a7dde-34f8-4f54-aa60-87bf6bf7f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:41.181164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a7dde-34f8-4f54-aa60-87bf6bf7f945 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.181429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a7dde-34f8-4f54-aa60-87bf6bf7f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.181741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a7dde-34f8-4f54-aa60-87bf6bf7f945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.182518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a7dde-34f8-4f54-aa60-87bf6bf7f945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:41.185188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a7dde-34f8-4f54-aa60-87bf6bf7f945 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:41.197018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1083/2168] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:41.201335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:41.211671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a923b8-22fd-425f-85bc-f38043313158 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:41.216418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:41.217085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.217372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.217651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] PATH_INFO: `/v3/projects/23e578670e36415f8eba98b6fde01f73/users/6f6fd73c194646fe83616869002ad85c/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.233083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e578670e36415f8eba98b6fde01f73, user_id=6f6fd73c194646fe83616869002ad85c, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:41.235833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:41.249920 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1086/2169] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:41 2022] PUT /identity/v3/projects/23e578670e36415f8eba98b6fde01f73/users/6f6fd73c194646fe83616869002ad85c/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:41.261020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc6e1-8c77-40d0-a5b2-6b527d19fa59 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.261308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc6e1-8c77-40d0-a5b2-6b527d19fa59 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.261586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc6e1-8c77-40d0-a5b2-6b527d19fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.292391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9d4cc6e1-8c77-40d0-a5b2-6b527d19fa59 None None] MFA Rules not processed for user `6f6fd73c194646fe83616869002ad85c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:41.293617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9d4cc6e1-8c77-40d0-a5b2-6b527d19fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:41.400354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1084/2170] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:41.426114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:41.427900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:41.514615 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900f68-8075-41c0-93c0-acfc46443ba3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:41.519352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbc002-dcfc-48cb-8071-5a6290537ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:41.520212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbc002-dcfc-48cb-8071-5a6290537ecb service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.520647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbc002-dcfc-48cb-8071-5a6290537ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.521075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbc002-dcfc-48cb-8071-5a6290537ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.531822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbc002-dcfc-48cb-8071-5a6290537ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:41.533621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbc002-dcfc-48cb-8071-5a6290537ecb service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:41.545946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1087/2171] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:41.570644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc6e1-8c77-40d0-a5b2-6b527d19fa59 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:41.598091 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:41.673940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc6e1-8c77-40d0-a5b2-6b527d19fa59 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:41.678397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:41.679035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.679337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.680757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] PATH_INFO: `/v3/users/6f6fd73c194646fe83616869002ad85c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.681975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6fd73c194646fe83616869002ad85c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:41.684040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:41.734835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6fd73c194646fe83616869002ad85c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:41.746314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6fd73c194646fe83616869002ad85c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:41.756138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6fd73c194646fe83616869002ad85c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:41.756842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6fd73c194646fe83616869002ad85c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:41.757522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6fd73c194646fe83616869002ad85c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:41.777099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1085/2172] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:41 2022] DELETE /identity/v3/users/6f6fd73c194646fe83616869002ad85c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:41.781836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:41.782286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:41.782454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:41.808059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:41.809272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:41.818636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:41.874235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1088/2173] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:41.884375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:41.892421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:41.998863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8050d64-f649-4546-ab4e-34833e6477f9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:42.003190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693a5a9-082e-4439-8c00-95bfb570608c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:42.005094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a5a9-082e-4439-8c00-95bfb570608c service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.005407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a5a9-082e-4439-8c00-95bfb570608c service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.005689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693a5a9-082e-4439-8c00-95bfb570608c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.016755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693a5a9-082e-4439-8c00-95bfb570608c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:42.018208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693a5a9-082e-4439-8c00-95bfb570608c service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:42.037275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1086/2174] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:42.333305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:42.335395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:42.360823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154db34-99b4-4c00-92c4-c9d3ea0ceaff None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:42.371010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:42.372637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.374189 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.375234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] PATH_INFO: `/v3/projects/23e578670e36415f8eba98b6fde01f73` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.378822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e578670e36415f8eba98b6fde01f73)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:42.383425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:42.476934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e578670e36415f8eba98b6fde01f73', 'request_id': 'req-e2bfd361-824d-4abf-909b-b7b3ac533c43'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:42.484667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e578670e36415f8eba98b6fde01f73', 'request_id': 'req-e2bfd361-824d-4abf-909b-b7b3ac533c43'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:42.495017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e578670e36415f8eba98b6fde01f73', 'request_id': 'req-e2bfd361-824d-4abf-909b-b7b3ac533c43'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:42.512314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] The token cache is being invalidate because project 23e578670e36415f8eba98b6fde01f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:42.512526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:42.513458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e2bfd361-824d-4abf-909b-b7b3ac533c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:42.517030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1089/2175] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:42 2022] DELETE /identity/v3/projects/23e578670e36415f8eba98b6fde01f73 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:42.521147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20076-c680-4b39-8d93-e32d59334d2a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.521443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20076-c680-4b39-8d93-e32d59334d2a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.521722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20076-c680-4b39-8d93-e32d59334d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.544893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e2e20076-c680-4b39-8d93-e32d59334d2a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:42.546484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e2e20076-c680-4b39-8d93-e32d59334d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:42.588542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:42.623916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1087/2176] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:19:42.632326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28fd72-1188-4b7b-addf-2ab77b48d50a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.633320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28fd72-1188-4b7b-addf-2ab77b48d50a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.633676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28fd72-1188-4b7b-addf-2ab77b48d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.655728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9a28fd72-1188-4b7b-addf-2ab77b48d50a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:42.657167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9a28fd72-1188-4b7b-addf-2ab77b48d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:42.667721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1090/2177] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:42.672224 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20076-c680-4b39-8d93-e32d59334d2a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:42.688083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20076-c680-4b39-8d93-e32d59334d2a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:42.699633 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:42.700276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.700559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.700879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.702042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:42.702042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:42.704346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:42.723320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1088/2178] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:42.725158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28fd72-1188-4b7b-addf-2ab77b48d50a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:42.735558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28fd72-1188-4b7b-addf-2ab77b48d50a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:42.744544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:42.745293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.745636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.745985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.746750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:42.751205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:42.788513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1091/2179] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:42 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:42.793803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:42.811244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05421226-23e4-4522-aaf9-cc0365ea6b54 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:42.908630 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:42.909271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.909546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.909824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.910521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:42.912506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:42.950813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1089/2180] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:42 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:42.951963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:42.965590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9b6a9-90d4-4ee6-ac18-760301f419eb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:42.970642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:42.971458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:42.971572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:42.971870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:42.973247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:42.974893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:42.991188 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1092/2181] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:42.993381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:43.011765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91efa-fd7c-4be5-9dbc-4783280787fe admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:43.016874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d655b2-96cd-4c1b-937e-28a530218672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:43.017496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d655b2-96cd-4c1b-937e-28a530218672 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:43.017796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d655b2-96cd-4c1b-937e-28a530218672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:43.018071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d655b2-96cd-4c1b-937e-28a530218672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:43.018781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d655b2-96cd-4c1b-937e-28a530218672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:43.020802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d655b2-96cd-4c1b-937e-28a530218672 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:43.036967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1090/2182] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:43.041766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:43.056475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3cba8-a90a-484b-8ddb-e0f8b36819c0 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:43.068683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:43.069564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:43.069933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:43.071137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] PATH_INFO: `/v3/projects/4771ae65173b4ab7b473fbfd372c6716/users/62a9f8a0c0e143148e7880e24f589dda/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:43.088091 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4771ae65173b4ab7b473fbfd372c6716, user_id=62a9f8a0c0e143148e7880e24f589dda, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:43.090800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:43.108635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1093/2183] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:43 2022] PUT /identity/v3/projects/4771ae65173b4ab7b473fbfd372c6716/users/62a9f8a0c0e143148e7880e24f589dda/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:43.119719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10802324-ca48-4e22-b724-068669c58751 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:43.120002 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10802324-ca48-4e22-b724-068669c58751 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:43.120280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10802324-ca48-4e22-b724-068669c58751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:43.154270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-10802324-ca48-4e22-b724-068669c58751 None None] MFA Rules not processed for user `62a9f8a0c0e143148e7880e24f589dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:43.155650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-10802324-ca48-4e22-b724-068669c58751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:43.238614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1091/2184] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:43.254643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:43.256747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:43.314380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:43.357056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2f3c2-2036-406a-9bb4-eda63fecba44 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:43.361504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:43.362727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:43.362727 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:43.362929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:43.379295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:43.379295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:43.389458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1094/2185] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:44.588375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10802324-ca48-4e22-b724-068669c58751 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:44.590453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-10802324-ca48-4e22-b724-068669c58751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:44.636138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:44.685040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10802324-ca48-4e22-b724-068669c58751 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:44.690060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:44.690901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:44.691367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:44.691819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] PATH_INFO: `/v3/users/c368c7af0b2645d28aaa637444bbd152` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:44.693373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c368c7af0b2645d28aaa637444bbd152)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:44.695553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:44.773692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c368c7af0b2645d28aaa637444bbd152'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:44.781820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c368c7af0b2645d28aaa637444bbd152'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:44.790246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c368c7af0b2645d28aaa637444bbd152'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:44.791095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c368c7af0b2645d28aaa637444bbd152'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:44.792134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c368c7af0b2645d28aaa637444bbd152'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:44.812733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1092/2186] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:44 2022] DELETE /identity/v3/users/c368c7af0b2645d28aaa637444bbd152 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:45.026736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:45.044139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b5b3-d716-4a42-b4f6-ca21887fc07a service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:45.150779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:45.151467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:45.151750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:45.152082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] PATH_INFO: `/v3/projects/df10f90027b84ab4aa181446031e904f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:45.153207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df10f90027b84ab4aa181446031e904f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:45.155148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:45.208019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df10f90027b84ab4aa181446031e904f', 'request_id': 'req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.216066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df10f90027b84ab4aa181446031e904f', 'request_id': 'req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.223640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df10f90027b84ab4aa181446031e904f', 'request_id': 'req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.237148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] The token cache is being invalidate because project df10f90027b84ab4aa181446031e904f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:45.237445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.238106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.239680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1095/2187] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:45 2022] DELETE /identity/v3/projects/df10f90027b84ab4aa181446031e904f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:45.245352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:45.246953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:45.262825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc1f39-04aa-4d86-9a93-6adee75c6a88 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:45.329828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:45.330537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:45.331123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:45.331448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] PATH_INFO: `/v3/users/3d6cbc3b72d54690839061e7d6eab9a3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:45.333275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6cbc3b72d54690839061e7d6eab9a3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:45.334985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:45.385617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6cbc3b72d54690839061e7d6eab9a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.395700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6cbc3b72d54690839061e7d6eab9a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.397017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:45.406821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6cbc3b72d54690839061e7d6eab9a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.407813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6cbc3b72d54690839061e7d6eab9a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.408520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-43c3c357-74ba-4fc3-a391-9fcf13042b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6cbc3b72d54690839061e7d6eab9a3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.427517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1093/2188] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:45 2022] DELETE /identity/v3/users/3d6cbc3b72d54690839061e7d6eab9a3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:45.612316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:45.613881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:45.634731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2737c-3501-4d1c-ab2e-3c04022cdf99 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:45.717743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:45.718674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:45.718814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:45.719186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] PATH_INFO: `/v3/projects/1a6c2b9e2a1e401a99ce62d702c59e62` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:45.720580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6c2b9e2a1e401a99ce62d702c59e62)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:45.723879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:45.761544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:45.808336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6c2b9e2a1e401a99ce62d702c59e62', 'request_id': 'req-c4b0fb2f-e946-426b-be97-823c7092bc0d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.822686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6c2b9e2a1e401a99ce62d702c59e62', 'request_id': 'req-c4b0fb2f-e946-426b-be97-823c7092bc0d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.832308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6c2b9e2a1e401a99ce62d702c59e62', 'request_id': 'req-c4b0fb2f-e946-426b-be97-823c7092bc0d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.845103 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] The token cache is being invalidate because project 1a6c2b9e2a1e401a99ce62d702c59e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:45.845395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.846036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4b0fb2f-e946-426b-be97-823c7092bc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:45.847613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1096/2189] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:45 2022] DELETE /identity/v3/projects/1a6c2b9e2a1e401a99ce62d702c59e62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:45.854465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812ed4b-435e-47c3-911b-e503a7fb6c47 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:45.854950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812ed4b-435e-47c3-911b-e503a7fb6c47 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:45.855067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812ed4b-435e-47c3-911b-e503a7fb6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:45.875121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8812ed4b-435e-47c3-911b-e503a7fb6c47 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:45.876367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8812ed4b-435e-47c3-911b-e503a7fb6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:45.935105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1094/2190] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:45.942723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a9409-6131-4547-95fc-52ebcb4f683e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:45.943012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a9409-6131-4547-95fc-52ebcb4f683e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:45.943314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a9409-6131-4547-95fc-52ebcb4f683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:45.964525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-847a9409-6131-4547-95fc-52ebcb4f683e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:45.965734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-847a9409-6131-4547-95fc-52ebcb4f683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:45.973578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1097/2191] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:45.977922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812ed4b-435e-47c3-911b-e503a7fb6c47 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:45.988283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812ed4b-435e-47c3-911b-e503a7fb6c47 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:45.993053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:45.993584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:45.993942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:45.994223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:45.995006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:45.995349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:45.996984 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.011331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1095/2192] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:19:46.014389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a9409-6131-4547-95fc-52ebcb4f683e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.024135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a9409-6131-4547-95fc-52ebcb4f683e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.028915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.029682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.029873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.030082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.030760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.032697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.064279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1098/2193] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:46 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:46.065615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.077454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf188bd-defd-4401-a439-185fdffb4b68 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.145368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.146264 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.146598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.146959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.147743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.151108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.183928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1096/2194] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:46 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:46.188368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.199754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce279a34-cbd3-42b5-b284-5dc19a44e962 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.204525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.205144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.205426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.205694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.206389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.208182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.219103 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1099/2195] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:46.223380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.235597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e05db-9324-44f7-946d-7125c49bb097 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.241502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9b2f0-7182-44fd-8764-5f9630893f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.242635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b2f0-7182-44fd-8764-5f9630893f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.242953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b2f0-7182-44fd-8764-5f9630893f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.243229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b2f0-7182-44fd-8764-5f9630893f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.243994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9b2f0-7182-44fd-8764-5f9630893f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.245741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9b2f0-7182-44fd-8764-5f9630893f21 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.262538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1097/2196] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:46.267306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.280052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252bee3-e94b-4be4-90d4-9a34e6d4272e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.286458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.288065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.289229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.290289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] PATH_INFO: `/v3/projects/fc4e6cb3381f4e10822fe76576428251/users/1c12f6c5b4444406af815db23554d8ab/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.316814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4e6cb3381f4e10822fe76576428251, user_id=1c12f6c5b4444406af815db23554d8ab, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.319812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.350932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1100/2197] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:46 2022] PUT /identity/v3/projects/fc4e6cb3381f4e10822fe76576428251/users/1c12f6c5b4444406af815db23554d8ab/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:46.362289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f34e-3d2d-40eb-947b-e910f33bc030 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.362903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f34e-3d2d-40eb-947b-e910f33bc030 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.363410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f34e-3d2d-40eb-947b-e910f33bc030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.405951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0149f34e-3d2d-40eb-947b-e910f33bc030 None None] MFA Rules not processed for user `1c12f6c5b4444406af815db23554d8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:46.407431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0149f34e-3d2d-40eb-947b-e910f33bc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:46.436176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:46.480616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1098/2198] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:46.485768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.564996 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bb03e-a03a-4342-a83b-69762e0b506a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.569719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.570917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.571190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.571531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.572207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.574119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.601166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1101/2199] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:46 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:46.605232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149f34e-3d2d-40eb-947b-e910f33bc030 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.617344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149f34e-3d2d-40eb-947b-e910f33bc030 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.686196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.686834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.687156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.688146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.689572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.691887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.720980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1099/2200] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:46 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:46.725280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.748334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772c462-ab24-407c-a275-e04360df7fa1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.755426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.756384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.756817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.758921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.759898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.761834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.775519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1102/2201] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:46.779801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.791509 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd008d1-a91a-4e4c-81d1-3029c103e3cb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.796455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c91809-27d1-488a-9223-cf21e221d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.797158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c91809-27d1-488a-9223-cf21e221d78b admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.797515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c91809-27d1-488a-9223-cf21e221d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.797855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c91809-27d1-488a-9223-cf21e221d78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.798620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c91809-27d1-488a-9223-cf21e221d78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.800473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c91809-27d1-488a-9223-cf21e221d78b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.814827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1100/2202] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:46.816210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:46.826938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473105-d7e4-46ce-abb4-d7c3921a404c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:46.831741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:46.832425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.832665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.832940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] PATH_INFO: `/v3/projects/f58c43f36f4e400899ceebac2a823122/users/ea1e218a55f2482a8f0f65cd646ad20d/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.838468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:46.852846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58c43f36f4e400899ceebac2a823122, user_id=ea1e218a55f2482a8f0f65cd646ad20d, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:46.856796 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:46.879347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1103/2203] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:46 2022] PUT /identity/v3/projects/f58c43f36f4e400899ceebac2a823122/users/ea1e218a55f2482a8f0f65cd646ad20d/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:46.885033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2c57-adaa-4174-aee1-2a4a418d25a1 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:46.885523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2c57-adaa-4174-aee1-2a4a418d25a1 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:46.885602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2c57-adaa-4174-aee1-2a4a418d25a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:46.916561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4b7d2c57-adaa-4174-aee1-2a4a418d25a1 None None] MFA Rules not processed for user `ea1e218a55f2482a8f0f65cd646ad20d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:46.918163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4b7d2c57-adaa-4174-aee1-2a4a418d25a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:46.989026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1101/2204] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:46.994505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:47.059851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d7c9b-99de-466c-a2ae-1df20cc61972 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:47.064759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:47.065381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.065669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.065949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.066624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:47.068572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:47.095976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1104/2205] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:46 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:47.100168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2c57-adaa-4174-aee1-2a4a418d25a1 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:47.111658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2c57-adaa-4174-aee1-2a4a418d25a1 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:47.143445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:47.172096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:47.172717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.173001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.173276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.173948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:47.176079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:47.198991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1102/2206] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:47 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:47.203240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:47.214328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae30e8-fe79-473c-9ef8-537c730a70e7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:47.219147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:47.219861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.220134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.220404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.221089 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:47.222726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:47.238277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1105/2207] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:47.239361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:47.250772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bd270-056c-477c-949c-24a366168d48 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:47.256233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:47.256900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.257179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.257544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] PATH_INFO: `/v3/projects/fa114e93b6ad48baafdeaa5777b85c3d/users/d3f37924cf9245ae85a1599dd3c90c09/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.274710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa114e93b6ad48baafdeaa5777b85c3d, user_id=d3f37924cf9245ae85a1599dd3c90c09, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:47.277542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:47.291468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1103/2208] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:47 2022] PUT /identity/v3/projects/fa114e93b6ad48baafdeaa5777b85c3d/users/d3f37924cf9245ae85a1599dd3c90c09/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:47.295341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:47.305820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c1ff2-75cd-4fe1-bca6-f67c819b6b9e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:47.364174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220921d-0b9d-4a64-8bb0-9839f322e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:47.364820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220921d-0b9d-4a64-8bb0-9839f322e142 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.365104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220921d-0b9d-4a64-8bb0-9839f322e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.365380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220921d-0b9d-4a64-8bb0-9839f322e142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.366071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220921d-0b9d-4a64-8bb0-9839f322e142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:47.367949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220921d-0b9d-4a64-8bb0-9839f322e142 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:47.377818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1106/2209] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:47.382050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:47.392805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ca2b9-37e0-49fb-86a1-a40fe290ec39 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:47.398561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:47.399250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.399560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.399834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] PATH_INFO: `/v3/projects/fa114e93b6ad48baafdeaa5777b85c3d/users/d3f37924cf9245ae85a1599dd3c90c09/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.401922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa114e93b6ad48baafdeaa5777b85c3d, user_id=d3f37924cf9245ae85a1599dd3c90c09, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:47.404841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:47.423008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1104/2210] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:47 2022] PUT /identity/v3/projects/fa114e93b6ad48baafdeaa5777b85c3d/users/d3f37924cf9245ae85a1599dd3c90c09/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:47.438859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.439151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.439521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.471147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] MFA Rules not processed for user `d3f37924cf9245ae85a1599dd3c90c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:47.472449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:47.521838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:47.548387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1107/2211] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:47.568036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:47.570530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:47.629600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687912-831b-4c1a-95b6-b5ce8fa4df7f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:47.633844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:47.634457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:47.634739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:47.635017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:47.692535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:47.693976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:47.703544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1105/2212] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:49.254958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:49.259059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:49.277187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854ff0-f8a4-4d3f-a77a-4b46d2e7dc6c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:49.281919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f42128-f3b3-47ce-b919-7278f4137f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:49.282547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42128-f3b3-47ce-b919-7278f4137f68 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:49.282832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42128-f3b3-47ce-b919-7278f4137f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:49.283104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42128-f3b3-47ce-b919-7278f4137f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:49.353097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42128-f3b3-47ce-b919-7278f4137f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:49.354481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42128-f3b3-47ce-b919-7278f4137f68 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:49.365034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1108/2213] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:49.455381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:49.456927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:49.505588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:49.528428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e68c9-0ee5-4154-a12b-33cf89b1d4f4 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:49.533102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:49.533911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:49.534199 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:49.534496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] PATH_INFO: `/v3/users/0b429a111ce241fe92c92c46dde19978` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:49.535848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b429a111ce241fe92c92c46dde19978)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:49.538266 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:49.587693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b429a111ce241fe92c92c46dde19978'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:49.595846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b429a111ce241fe92c92c46dde19978'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:49.603246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b429a111ce241fe92c92c46dde19978'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:49.603904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b429a111ce241fe92c92c46dde19978'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:49.604519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b429a111ce241fe92c92c46dde19978'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:49.623478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1106/2214] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:49 2022] DELETE /identity/v3/users/0b429a111ce241fe92c92c46dde19978 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:49.628041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:49.628699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:49.629038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:49.650093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:49.651358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:49.716171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1109/2215] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:49.733848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:49.735654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:49.802876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd9ea-fada-4670-925b-9e6ed4ce51fa admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:49.807337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:49.807958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:49.808245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:49.808523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:49.817931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:49.819395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:49.829801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1107/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:49.931841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:49.933436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:50.018157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf312-3361-415d-bfaa-16f5e7072633 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.022136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478ebbb-c6a2-4c88-a755-d6b6371520b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.022834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ebbb-c6a2-4c88-a755-d6b6371520b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.024094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ebbb-c6a2-4c88-a755-d6b6371520b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.024254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ebbb-c6a2-4c88-a755-d6b6371520b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.026197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2478ebbb-c6a2-4c88-a755-d6b6371520b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:50.073067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:50.117979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478ebbb-c6a2-4c88-a755-d6b6371520b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.119550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478ebbb-c6a2-4c88-a755-d6b6371520b4 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.124942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.126432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:50.141759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf56d35-711b-4c7e-9532-55902bef4a6c service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.148920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.149883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.150371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.150854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] PATH_INFO: `/v3/projects/b0ebdd719d1740bcbe2c1ad7f0837ff0` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.150964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1110/2217] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:50.154014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ebdd719d1740bcbe2c1ad7f0837ff0)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.158015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.244387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ebdd719d1740bcbe2c1ad7f0837ff0', 'request_id': 'req-63fd07e0-c815-438d-8e8e-c7d12022cd84'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:50.254545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ebdd719d1740bcbe2c1ad7f0837ff0', 'request_id': 'req-63fd07e0-c815-438d-8e8e-c7d12022cd84'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:50.257017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:50.263653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ebdd719d1740bcbe2c1ad7f0837ff0', 'request_id': 'req-63fd07e0-c815-438d-8e8e-c7d12022cd84'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:50.281670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] The token cache is being invalidate because project b0ebdd719d1740bcbe2c1ad7f0837ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:50.281972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:50.283774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-63fd07e0-c815-438d-8e8e-c7d12022cd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:50.287496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1108/2218] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:50 2022] DELETE /identity/v3/projects/b0ebdd719d1740bcbe2c1ad7f0837ff0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:50.290512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa1b-63a1-4565-8703-49483c988665 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.291344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa1b-63a1-4565-8703-49483c988665 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.291821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa1b-63a1-4565-8703-49483c988665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.316960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-87adaa1b-63a1-4565-8703-49483c988665 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:50.318198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-87adaa1b-63a1-4565-8703-49483c988665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:50.428579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1111/2219] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:50.438001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8934-8eb8-48a5-a0fc-6317dad93d18 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.438354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8934-8eb8-48a5-a0fc-6317dad93d18 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.438724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8934-8eb8-48a5-a0fc-6317dad93d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.463940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3a3a8934-8eb8-48a5-a0fc-6317dad93d18 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:50.467195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3a3a8934-8eb8-48a5-a0fc-6317dad93d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:50.480083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1109/2220] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:50.485119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa1b-63a1-4565-8703-49483c988665 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.500670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa1b-63a1-4565-8703-49483c988665 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.508794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.509399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.509681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.510164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.510887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:19:50.511197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.512852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.532452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1112/2221] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:19:50.536474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a8934-8eb8-48a5-a0fc-6317dad93d18 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.549444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a8934-8eb8-48a5-a0fc-6317dad93d18 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.554473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.555255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.555573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.556013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.557107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.558743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.603250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1110/2222] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:19:50 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:19:50.607473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.619093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe75f-817c-47ff-8714-050422c2b83b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.697257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.698103 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.698375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.698658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.699405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.702650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.731908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1113/2223] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:19:50 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:19:50.736235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.750019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929e690-6e46-464c-9b83-aa8ff3daad8a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.755728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.756562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.756850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.757178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.757905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.759604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.771308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1111/2224] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:50.776082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.788102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d535a-de03-48cd-8987-0c7c13c03f57 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.793654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672e011-9436-4482-b0fe-01a43d1db51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.794277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672e011-9436-4482-b0fe-01a43d1db51a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.794582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672e011-9436-4482-b0fe-01a43d1db51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.794842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672e011-9436-4482-b0fe-01a43d1db51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.795586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672e011-9436-4482-b0fe-01a43d1db51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.797259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672e011-9436-4482-b0fe-01a43d1db51a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.811305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1114/2225] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:19:50.813841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.825722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059597f-a737-450e-806d-81d66263fa83 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:50.830891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:50.831639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.831927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.832206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] PATH_INFO: `/v3/projects/54e9db867ee64a33a34537e25c0072fd/users/3e12dd63fb8c4b7e87065aba94958e04/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.849952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e9db867ee64a33a34537e25c0072fd, user_id=3e12dd63fb8c4b7e87065aba94958e04, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:50.853334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:50.869010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1112/2226] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:19:50 2022] PUT /identity/v3/projects/54e9db867ee64a33a34537e25c0072fd/users/3e12dd63fb8c4b7e87065aba94958e04/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:50.874085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a2cf-2737-4d6f-a05b-95f308b40ff1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:50.874493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a2cf-2737-4d6f-a05b-95f308b40ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:50.874838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a2cf-2737-4d6f-a05b-95f308b40ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:50.893608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f545a2cf-2737-4d6f-a05b-95f308b40ff1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:50.894895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f545a2cf-2737-4d6f-a05b-95f308b40ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:50.926460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:50.956924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1115/2227] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:50.966077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:50.967774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:51.024027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ecf20-1151-451c-80b7-4d8ff93cfe37 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:51.027591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:51.028768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:51.029041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:51.029309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:51.038110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:51.040183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:51.049280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1113/2228] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:51.928111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afdc2b-4779-4be4-b0ca-c438d1580fb0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:51.928643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afdc2b-4779-4be4-b0ca-c438d1580fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:51.928643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afdc2b-4779-4be4-b0ca-c438d1580fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:51.961812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f7afdc2b-4779-4be4-b0ca-c438d1580fb0 None None] MFA Rules not processed for user `3e12dd63fb8c4b7e87065aba94958e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:51.963039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f7afdc2b-4779-4be4-b0ca-c438d1580fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:52.057062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1116/2229] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:52.069177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:52.071975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:52.154030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467d97-dbdc-445d-9692-ac5e3294bf4a service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:52.157924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:52.158579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:52.158891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:52.159172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:52.168680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:52.170249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:52.179814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1114/2230] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:53.560131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760619c-f8d4-4d9d-b3ca-50376a1ac2b2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:53.560713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760619c-f8d4-4d9d-b3ca-50376a1ac2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:53.560713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760619c-f8d4-4d9d-b3ca-50376a1ac2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:53.581052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7760619c-f8d4-4d9d-b3ca-50376a1ac2b2 None None] MFA Rules not processed for user `3e12dd63fb8c4b7e87065aba94958e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:53.582286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7760619c-f8d4-4d9d-b3ca-50376a1ac2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:53.589890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1117/2231] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:54.266220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:54.268254 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:54.308409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a4057-ec27-43c5-b98b-2b31e6625489 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:54.315392 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:54.316150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:54.316712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:54.317095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] PATH_INFO: `/v3/users/1c12f6c5b4444406af815db23554d8ab` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:54.333576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c12f6c5b4444406af815db23554d8ab)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:54.333576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:54.364196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:54.402051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c12f6c5b4444406af815db23554d8ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:54.412671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c12f6c5b4444406af815db23554d8ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:54.422679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c12f6c5b4444406af815db23554d8ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:54.423697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c12f6c5b4444406af815db23554d8ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:54.424648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c12f6c5b4444406af815db23554d8ab'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:54.449291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1115/2232] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:54 2022] DELETE /identity/v3/users/1c12f6c5b4444406af815db23554d8ab => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:54.454220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:54.454613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:54.454817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:54.479484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:54.480380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:54.593164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1118/2233] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:54.606305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:54.608447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:54.675952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42903e-bb5f-4e8c-8413-20c15ba24c28 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:54.680659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:54.681496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:54.681940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:54.682376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:54.697389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:54.699305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:54.710833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1116/2234] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:19:55.076272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:55.077955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:55.090683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0bfc7-68c2-4460-a587-d01067a83567 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:55.097110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:55.097777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:55.098064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:55.098343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] PATH_INFO: `/v3/projects/fc4e6cb3381f4e10822fe76576428251` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:55.099626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4e6cb3381f4e10822fe76576428251)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:55.102385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:55.166279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4e6cb3381f4e10822fe76576428251', 'request_id': 'req-7b9d6bce-a008-46d4-85e0-175491297b34'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.170461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:55.172863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4e6cb3381f4e10822fe76576428251', 'request_id': 'req-7b9d6bce-a008-46d4-85e0-175491297b34'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.182627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4e6cb3381f4e10822fe76576428251', 'request_id': 'req-7b9d6bce-a008-46d4-85e0-175491297b34'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.194560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] The token cache is being invalidate because project fc4e6cb3381f4e10822fe76576428251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:55.195040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.196111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.197896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1119/2235] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:55 2022] DELETE /identity/v3/projects/fc4e6cb3381f4e10822fe76576428251 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:55.202038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:55.212458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161b0ec-0302-4689-a33c-74ebbd8275e8 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:55.270412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:55.271119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:55.271553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:55.271835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] PATH_INFO: `/v3/users/ea1e218a55f2482a8f0f65cd646ad20d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:55.273534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1e218a55f2482a8f0f65cd646ad20d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:55.275670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:55.321852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:55.323813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1e218a55f2482a8f0f65cd646ad20d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.333593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1e218a55f2482a8f0f65cd646ad20d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.341691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1e218a55f2482a8f0f65cd646ad20d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.342408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1e218a55f2482a8f0f65cd646ad20d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.342998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-95a52078-64c2-4ada-a285-68c9de78b7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1e218a55f2482a8f0f65cd646ad20d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.364226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1117/2236] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:55 2022] DELETE /identity/v3/users/ea1e218a55f2482a8f0f65cd646ad20d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:55.484781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:55.487124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:55.504683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d6bce-a008-46d4-85e0-175491297b34 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:55.580178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:55.580951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:55.581351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:55.581725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] PATH_INFO: `/v3/users/62a9f8a0c0e143148e7880e24f589dda` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:55.583068 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a9f8a0c0e143148e7880e24f589dda)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:55.585171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:55.659943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a9f8a0c0e143148e7880e24f589dda'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.660847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a9f8a0c0e143148e7880e24f589dda'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.662251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a9f8a0c0e143148e7880e24f589dda'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.678427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a9f8a0c0e143148e7880e24f589dda'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.686597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a9f8a0c0e143148e7880e24f589dda'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.702676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1120/2237] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:55 2022] DELETE /identity/v3/users/62a9f8a0c0e143148e7880e24f589dda => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:55.707032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:55.707355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:55.707640 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:55.735978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:55.737216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:55.759023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:55.760531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:55.848558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1118/2238] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:19:55.860013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:55.861454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:55.868054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec090-cb84-413f-bc3a-73521f73293d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:55.874207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:55.875580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:55.876135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:55.876627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] PATH_INFO: `/v3/projects/f58c43f36f4e400899ceebac2a823122` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:55.878311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58c43f36f4e400899ceebac2a823122)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:55.880848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:55.884125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:55.986105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cf95a-0566-43f3-b8bf-e50934c98b4c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:55.987938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58c43f36f4e400899ceebac2a823122', 'request_id': 'req-eb571fdd-269f-4bcd-9f27-654d3aff3bab'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:55.999955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58c43f36f4e400899ceebac2a823122', 'request_id': 'req-eb571fdd-269f-4bcd-9f27-654d3aff3bab'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.017042 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58c43f36f4e400899ceebac2a823122', 'request_id': 'req-eb571fdd-269f-4bcd-9f27-654d3aff3bab'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.038094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] The token cache is being invalidate because project f58c43f36f4e400899ceebac2a823122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:56.038407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.046082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.048012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1121/2239] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:55 2022] DELETE /identity/v3/projects/f58c43f36f4e400899ceebac2a823122 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:56.051882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:56.053324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:56.119222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:56.119993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:56.121823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:56.123125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:56.129421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:56.183751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb571fdd-269f-4bcd-9f27-654d3aff3bab admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:56.203484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:56.204597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:56.205063 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:56.206652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] PATH_INFO: `/v3/users/d3f37924cf9245ae85a1599dd3c90c09` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:56.212826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f37924cf9245ae85a1599dd3c90c09)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:56.217913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:56.230449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:56.299614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:56.302048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:56.317496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1119/2240] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:19:56.329633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f37924cf9245ae85a1599dd3c90c09'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.330736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f37924cf9245ae85a1599dd3c90c09'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.331596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f37924cf9245ae85a1599dd3c90c09'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.347578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f37924cf9245ae85a1599dd3c90c09'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.368713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f37924cf9245ae85a1599dd3c90c09'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:56.389999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1122/2241] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:19:56 2022] DELETE /identity/v3/users/d3f37924cf9245ae85a1599dd3c90c09 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:57.149085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:57.151321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:57.176673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6840db-17b1-40bc-b016-31ef9f386ce2 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:57.212697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:19:57.214557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:57.241135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:19:57.277704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:57.278361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:57.278637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:57.279179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] PATH_INFO: `/v3/projects/4771ae65173b4ab7b473fbfd372c6716` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:57.280694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4771ae65173b4ab7b473fbfd372c6716)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:57.282666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:57.342792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a36a-3691-4310-a71a-716dd6dac155 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:19:57.343757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4771ae65173b4ab7b473fbfd372c6716', 'request_id': 'req-44076cdc-5776-481d-b5d6-c7dafeb41c43'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.355813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4771ae65173b4ab7b473fbfd372c6716', 'request_id': 'req-44076cdc-5776-481d-b5d6-c7dafeb41c43'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.366180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4771ae65173b4ab7b473fbfd372c6716', 'request_id': 'req-44076cdc-5776-481d-b5d6-c7dafeb41c43'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.393334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] The token cache is being invalidate because project 4771ae65173b4ab7b473fbfd372c6716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:57.393734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.399812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-44076cdc-5776-481d-b5d6-c7dafeb41c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.405771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1120/2242] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:57 2022] DELETE /identity/v3/projects/4771ae65173b4ab7b473fbfd372c6716 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:19:57.464967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:19:57.465643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:57.465932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:57.466210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] PATH_INFO: `/v3/projects/fa114e93b6ad48baafdeaa5777b85c3d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:57.467572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa114e93b6ad48baafdeaa5777b85c3d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:19:57.469636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:19:57.537443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa114e93b6ad48baafdeaa5777b85c3d', 'request_id': 'req-797c0bbb-4a3d-4008-95f4-798a1446f9ea'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.547183 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa114e93b6ad48baafdeaa5777b85c3d', 'request_id': 'req-797c0bbb-4a3d-4008-95f4-798a1446f9ea'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.557347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa114e93b6ad48baafdeaa5777b85c3d', 'request_id': 'req-797c0bbb-4a3d-4008-95f4-798a1446f9ea'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.570729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] The token cache is being invalidate because project fa114e93b6ad48baafdeaa5777b85c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:19:57.571029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.571748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-797c0bbb-4a3d-4008-95f4-798a1446f9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:19:57.573314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1123/2243] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:19:57 2022] DELETE /identity/v3/projects/fa114e93b6ad48baafdeaa5777b85c3d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:19:58.841228 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c8c91-7d3d-4e43-87c5-f38da2e96d38 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:19:58.841753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c8c91-7d3d-4e43-87c5-f38da2e96d38 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:19:58.841753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c8c91-7d3d-4e43-87c5-f38da2e96d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:19:58.868509 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-121c8c91-7d3d-4e43-87c5-f38da2e96d38 None None] MFA Rules not processed for user `0205970be73c4b949ab36a193db6eed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:19:58.870714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-121c8c91-7d3d-4e43-87c5-f38da2e96d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:19:58.938609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1121/2244] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:19:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:02.356126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:02.356658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:02.356658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:02.378043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] MFA Rules not processed for user `ce7376d180c047e2b4c8a79e260367e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:02.379886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:02.440323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:02.457172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1124/2245] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:08.931923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:12.474494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:17.956885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960acb-8d74-4f9a-945b-655c7d48dcb7 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:17.957368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960acb-8d74-4f9a-945b-655c7d48dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:17.957471 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960acb-8d74-4f9a-945b-655c7d48dcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:17.982256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fc960acb-8d74-4f9a-945b-655c7d48dcb7 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:17.983927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fc960acb-8d74-4f9a-945b-655c7d48dcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:18.052199 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1122/2246] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:18.098680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:18.101543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:18.183088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291cb5f-faaf-42ac-83b9-f483d05ba55f None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:18.188242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:18.188859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:18.189139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:18.189416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:18.198496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:18.200138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:18.208333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1125/2247] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:20:23.021537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9952-7473-4cbd-a77f-739e72946d70 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:23.022156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9952-7473-4cbd-a77f-739e72946d70 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:23.022156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9952-7473-4cbd-a77f-739e72946d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:23.042919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-23ea9952-7473-4cbd-a77f-739e72946d70 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:23.044239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-23ea9952-7473-4cbd-a77f-739e72946d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:23.058741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1123/2248] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:23.075562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:23.087277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793eba-8201-485b-b909-e3a58b2b0b21 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:23.093498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0964-0922-42f0-90bc-d4c7284d95da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:23.094485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0964-0922-42f0-90bc-d4c7284d95da service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:23.094900 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0964-0922-42f0-90bc-d4c7284d95da service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:23.095283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0964-0922-42f0-90bc-d4c7284d95da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:23.105723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0964-0922-42f0-90bc-d4c7284d95da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:23.107842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0964-0922-42f0-90bc-d4c7284d95da service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:23.117500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1126/2249] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:20:33.037012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=28 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:33.113470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=38 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:36.664030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9317b0-05ba-4a91-aec7-a518ce8daf4a None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:36.665778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9317b0-05ba-4a91-aec7-a518ce8daf4a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:36.666151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9317b0-05ba-4a91-aec7-a518ce8daf4a None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:36.674054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1124/2250] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:20:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:20:36.700656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0c430-3dd2-480c-9829-9f58ea59e9c3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:36.701082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0c430-3dd2-480c-9829-9f58ea59e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:36.701241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0c430-3dd2-480c-9829-9f58ea59e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:36.779836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-e6f0c430-3dd2-480c-9829-9f58ea59e9c3 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:36.781391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e6f0c430-3dd2-480c-9829-9f58ea59e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:36.881769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1127/2251] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:36.894681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9317b0-05ba-4a91-aec7-a518ce8daf4a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:36.897450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ec9317b0-05ba-4a91-aec7-a518ce8daf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:36.962030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9317b0-05ba-4a91-aec7-a518ce8daf4a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:36.966319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a6e0-4f8a-42b4-bf87-cf06d67ebece service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:36.966968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a6e0-4f8a-42b4-bf87-cf06d67ebece service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:36.967255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a6e0-4f8a-42b4-bf87-cf06d67ebece service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:36.967555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a6e0-4f8a-42b4-bf87-cf06d67ebece service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:36.979320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358a6e0-4f8a-42b4-bf87-cf06d67ebece service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:36.981075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358a6e0-4f8a-42b4-bf87-cf06d67ebece service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:36.993602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1125/2252] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:20:37.083033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede7a6-ba66-4bf3-972f-0e5e53cde784 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:37.083454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede7a6-ba66-4bf3-972f-0e5e53cde784 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:37.083927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede7a6-ba66-4bf3-972f-0e5e53cde784 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:37.087222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1128/2253] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:20:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:20:37.092638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902d377-6271-4d26-b3de-7fc141df59c3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:37.093393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902d377-6271-4d26-b3de-7fc141df59c3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:37.093721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902d377-6271-4d26-b3de-7fc141df59c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:37.118064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7902d377-6271-4d26-b3de-7fc141df59c3 None None] MFA Rules not processed for user `e90c842029d845bd8b4f12696354af78`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:37.119757 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7902d377-6271-4d26-b3de-7fc141df59c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:37.210094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1126/2254] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:20:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:37.224138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede7a6-ba66-4bf3-972f-0e5e53cde784 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:37.227404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-beede7a6-ba66-4bf3-972f-0e5e53cde784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:37.246745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede7a6-ba66-4bf3-972f-0e5e53cde784 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:37.252716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768b387-e271-412a-979e-f36f90601b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:37.253420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b387-e271-412a-979e-f36f90601b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:37.253765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b387-e271-412a-979e-f36f90601b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:37.254267 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b387-e271-412a-979e-f36f90601b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:37.265012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768b387-e271-412a-979e-f36f90601b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:37.266817 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768b387-e271-412a-979e-f36f90601b9d service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:37.277367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1129/2255] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:20:37.428944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a21f-1b7b-447b-bdf2-2336e9cb4b65 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:37.429433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a21f-1b7b-447b-bdf2-2336e9cb4b65 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:37.429801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a21f-1b7b-447b-bdf2-2336e9cb4b65 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:37.431342 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1127/2256] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:20:37.443752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1e1b-89e4-41a3-8a50-bd822991675c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:37.444386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1e1b-89e4-41a3-8a50-bd822991675c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:37.444864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e1e1b-89e4-41a3-8a50-bd822991675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:37.478804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-203e1e1b-89e4-41a3-8a50-bd822991675c None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:37.480003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-203e1e1b-89e4-41a3-8a50-bd822991675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:37.489705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1130/2257] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:20:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:37.500639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713a21f-1b7b-447b-bdf2-2336e9cb4b65 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:37.513823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713a21f-1b7b-447b-bdf2-2336e9cb4b65 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:37.517632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:37.518473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:37.518895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:37.519202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:37.531872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:37.534167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:37.547987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1128/2258] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:20:38.768532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023876-1887-4d5c-b7f3-f13119663cd1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:38.769058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023876-1887-4d5c-b7f3-f13119663cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:38.769258 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023876-1887-4d5c-b7f3-f13119663cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:38.791313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-00023876-1887-4d5c-b7f3-f13119663cd1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:38.792526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-00023876-1887-4d5c-b7f3-f13119663cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:38.865881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1131/2259] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:38.894032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:38.895658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:38.914207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbaf77-874f-4b51-9117-4db090bc36fc service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:38.920667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b4864-afc1-45b4-b45d-9c1492a7ab72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:38.921291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4864-afc1-45b4-b45d-9c1492a7ab72 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:38.921655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4864-afc1-45b4-b45d-9c1492a7ab72 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:38.921905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4864-afc1-45b4-b45d-9c1492a7ab72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:38.931481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b4864-afc1-45b4-b45d-9c1492a7ab72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:38.933281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b4864-afc1-45b4-b45d-9c1492a7ab72 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:38.944511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1129/2260] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:20:41.802858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:41.803481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:41.803577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:41.826472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:41.828741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:41.835310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646af1a-c57d-4803-9d3b-9963a8b6950f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:41.835838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646af1a-c57d-4803-9d3b-9963a8b6950f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:41.835931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646af1a-c57d-4803-9d3b-9963a8b6950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:41.838131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1132/2261] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:41.855760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:41.857249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:41.858805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8646af1a-c57d-4803-9d3b-9963a8b6950f None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:41.860704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8646af1a-c57d-4803-9d3b-9963a8b6950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:41.869030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1130/2262] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:41.874460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f50cb-66f1-412b-a272-376c3d0488a7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:41.882078 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:41.882931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:41.883363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646af1a-c57d-4803-9d3b-9963a8b6950f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:41.883616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:41.884044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:41.895776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:41.897948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:41.901202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646af1a-c57d-4803-9d3b-9963a8b6950f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:41.907360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:41.908175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1133/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:20:41.908464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:41.908945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:41.909482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:41.919551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:41.921447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:41.931366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1131/2264] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 04:20:43.914984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:43.916497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:43.931244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf67c8-6cd3-44a8-945d-24b5c7c97aaa service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:43.935892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:43.936803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:43.937093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:43.937372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] PATH_INFO: `/v3/users/0205970be73c4b949ab36a193db6eed7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:43.938535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0205970be73c4b949ab36a193db6eed7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:43.940692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:43.992399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0205970be73c4b949ab36a193db6eed7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:43.993061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0205970be73c4b949ab36a193db6eed7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:43.993672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0205970be73c4b949ab36a193db6eed7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:43.994968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:44.010631 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0205970be73c4b949ab36a193db6eed7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:44.017855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b187e69e-ba0a-44d3-bf7f-b5b33b9c39dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0205970be73c4b949ab36a193db6eed7'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:44.035639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1134/2265] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:20:43 2022] DELETE /identity/v3/users/0205970be73c4b949ab36a193db6eed7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:20:44.519444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:44.540900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49206691-341d-4fd6-a350-828f87908ca4 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:44.600583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:44.601229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:44.601514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:44.601792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] PATH_INFO: `/v3/projects/55c335d937424964ba4e858346c6610d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:44.602939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c335d937424964ba4e858346c6610d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:44.604893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:44.612931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:44.652089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c335d937424964ba4e858346c6610d', 'request_id': 'req-f867350a-553f-43c9-9e08-b6f0aff06e01'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:44.659168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c335d937424964ba4e858346c6610d', 'request_id': 'req-f867350a-553f-43c9-9e08-b6f0aff06e01'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:44.664745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c335d937424964ba4e858346c6610d', 'request_id': 'req-f867350a-553f-43c9-9e08-b6f0aff06e01'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:44.675379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] The token cache is being invalidate because project 55c335d937424964ba4e858346c6610d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:20:44.675668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:44.676390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f867350a-553f-43c9-9e08-b6f0aff06e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:44.678192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1132/2266] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:20:44 2022] DELETE /identity/v3/projects/55c335d937424964ba4e858346c6610d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:20:44.683056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0cab-d9a6-4ba0-8080-f2f22f40cabf None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:44.683375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0cab-d9a6-4ba0-8080-f2f22f40cabf None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:44.683654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0cab-d9a6-4ba0-8080-f2f22f40cabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:44.703501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-dd3a0cab-d9a6-4ba0-8080-f2f22f40cabf None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:44.704700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-dd3a0cab-d9a6-4ba0-8080-f2f22f40cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:44.765126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1135/2267] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:44.774234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05164111-1489-4696-9d14-92050de72e3a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:44.774522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05164111-1489-4696-9d14-92050de72e3a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:44.774796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05164111-1489-4696-9d14-92050de72e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:44.795001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-05164111-1489-4696-9d14-92050de72e3a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:44.796154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-05164111-1489-4696-9d14-92050de72e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:44.803989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1133/2268] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:44.808157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0cab-d9a6-4ba0-8080-f2f22f40cabf None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:44.817936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0cab-d9a6-4ba0-8080-f2f22f40cabf None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:44.822659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:44.823289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:44.823608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:44.823879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:44.824569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:20:44.824873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:44.826474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:44.838642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1136/2269] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:20:44.842765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05164111-1489-4696-9d14-92050de72e3a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:44.852914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05164111-1489-4696-9d14-92050de72e3a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:44.857846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:44.858446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:44.858730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:44.859005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:44.859721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:44.861636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:44.888088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1134/2270] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:20:44 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:20:44.891962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:44.903197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8fba-78d0-4cc5-901c-7ab66d2414e5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:44.959552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:44.960192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:44.960441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:44.960716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:44.961388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:44.963351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:44.984904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1137/2271] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:20:44 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:20:44.989167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:44.999953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461166c-a509-44db-bb9f-0a7583a6218c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:45.004396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:45.005000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.005303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.006034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.006719 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:45.008330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:45.018015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1135/2272] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:20:45.022206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:45.032021 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b55ae-a0de-401f-a3de-582d0365a2ba admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:45.037338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f5f3b-dea9-48d3-ac8a-65fc9042707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:45.037929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f5f3b-dea9-48d3-ac8a-65fc9042707f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.038207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f5f3b-dea9-48d3-ac8a-65fc9042707f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.038480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f5f3b-dea9-48d3-ac8a-65fc9042707f admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.039168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f5f3b-dea9-48d3-ac8a-65fc9042707f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:45.040839 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f5f3b-dea9-48d3-ac8a-65fc9042707f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:45.051468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1138/2273] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:20:45.056035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:45.066244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bee8f-1d42-4273-9a83-bf8d5cd865d7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:45.071801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:45.072448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.072726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.073005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] PATH_INFO: `/v3/projects/041a9be8d41c45caa3c18f67752dd8e4/users/f48da067a04a4688b329203eaed21a9f/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.087612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=041a9be8d41c45caa3c18f67752dd8e4, user_id=f48da067a04a4688b329203eaed21a9f, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:45.090319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:45.103081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1136/2274] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:20:45 2022] PUT /identity/v3/projects/041a9be8d41c45caa3c18f67752dd8e4/users/f48da067a04a4688b329203eaed21a9f/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:20:45.113487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281dbdb-77d7-44d1-b95e-f83110b7c899 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.113798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281dbdb-77d7-44d1-b95e-f83110b7c899 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.114074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281dbdb-77d7-44d1-b95e-f83110b7c899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.143162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a281dbdb-77d7-44d1-b95e-f83110b7c899 None None] MFA Rules not processed for user `f48da067a04a4688b329203eaed21a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:45.144420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a281dbdb-77d7-44d1-b95e-f83110b7c899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:45.162609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:45.209066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1139/2275] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:45.220124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:45.221781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:45.279902 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483f4b-acbd-47a0-881c-bc8166cea8fb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:45.283518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c05ad-23a4-4a50-b95d-62be9afdd0f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:45.284128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c05ad-23a4-4a50-b95d-62be9afdd0f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.284413 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c05ad-23a4-4a50-b95d-62be9afdd0f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.284694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c05ad-23a4-4a50-b95d-62be9afdd0f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.293841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c05ad-23a4-4a50-b95d-62be9afdd0f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:45.295288 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c05ad-23a4-4a50-b95d-62be9afdd0f9 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:45.304839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1137/2276] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:20:45.329509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281dbdb-77d7-44d1-b95e-f83110b7c899 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:45.393201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281dbdb-77d7-44d1-b95e-f83110b7c899 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:45.397873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:45.398508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.398790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.399062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] PATH_INFO: `/v3/users/f48da067a04a4688b329203eaed21a9f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.400270 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48da067a04a4688b329203eaed21a9f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:45.402198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:45.452575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48da067a04a4688b329203eaed21a9f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:45.453262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48da067a04a4688b329203eaed21a9f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:45.453893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48da067a04a4688b329203eaed21a9f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:45.466345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48da067a04a4688b329203eaed21a9f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:45.479023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48da067a04a4688b329203eaed21a9f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:45.505343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1140/2277] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:20:45 2022] DELETE /identity/v3/users/f48da067a04a4688b329203eaed21a9f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:20:45.509899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.510258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.510540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.529525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:45.530701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:45.563624 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:45.595836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1138/2278] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:45.623329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:45.624745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:45.670017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:45.685621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd23c8-aafd-406b-bf04-aec756be008e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:45.689216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10adfdf-7302-4f75-ace3-89d29ba3090f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:45.689829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10adfdf-7302-4f75-ace3-89d29ba3090f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:45.690106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10adfdf-7302-4f75-ace3-89d29ba3090f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:45.690379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10adfdf-7302-4f75-ace3-89d29ba3090f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:45.699726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10adfdf-7302-4f75-ace3-89d29ba3090f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:45.701177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10adfdf-7302-4f75-ace3-89d29ba3090f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:45.711917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1141/2279] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:20:45.996415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:45.998654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:46.017239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3e47-e82c-4a18-bca1-78dca19e227f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.024751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.025731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.026230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.026581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] PATH_INFO: `/v3/projects/041a9be8d41c45caa3c18f67752dd8e4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.028153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041a9be8d41c45caa3c18f67752dd8e4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.031350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.078972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041a9be8d41c45caa3c18f67752dd8e4', 'request_id': 'req-f813849f-ea9b-4b8a-87d1-bfab713f27b7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:46.086895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041a9be8d41c45caa3c18f67752dd8e4', 'request_id': 'req-f813849f-ea9b-4b8a-87d1-bfab713f27b7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:46.092635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041a9be8d41c45caa3c18f67752dd8e4', 'request_id': 'req-f813849f-ea9b-4b8a-87d1-bfab713f27b7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:46.103997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] The token cache is being invalidate because project 041a9be8d41c45caa3c18f67752dd8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:20:46.104280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:46.104905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f813849f-ea9b-4b8a-87d1-bfab713f27b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:20:46.106661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1139/2280] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:20:45 2022] DELETE /identity/v3/projects/041a9be8d41c45caa3c18f67752dd8e4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:20:46.111568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263f9cd-b39c-494d-83c2-02da1940c37e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.112061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263f9cd-b39c-494d-83c2-02da1940c37e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.112168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263f9cd-b39c-494d-83c2-02da1940c37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.132742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9263f9cd-b39c-494d-83c2-02da1940c37e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:46.133965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9263f9cd-b39c-494d-83c2-02da1940c37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:46.192339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1142/2281] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:46.260262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747457-9de3-4b0e-b8d4-a4e464d70ca0 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.260548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747457-9de3-4b0e-b8d4-a4e464d70ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.260826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747457-9de3-4b0e-b8d4-a4e464d70ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.281134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-82747457-9de3-4b0e-b8d4-a4e464d70ca0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:46.282323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-82747457-9de3-4b0e-b8d4-a4e464d70ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:46.291193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1140/2282] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:46.295634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263f9cd-b39c-494d-83c2-02da1940c37e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:46.305429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263f9cd-b39c-494d-83c2-02da1940c37e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.309909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.310510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.310792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.311096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.311895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:20:46.312197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.313825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.325319 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1143/2283] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:20:46.329543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747457-9de3-4b0e-b8d4-a4e464d70ca0 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:46.339508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747457-9de3-4b0e-b8d4-a4e464d70ca0 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.344119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.344720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.345007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.345280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.345954 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.347899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.374657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1141/2284] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:20:46 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:20:46.378633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:46.388767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4990a0-791c-4cfe-a850-63be3255941c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.443800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.444411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.444754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.444971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.445841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.447812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.469965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1144/2285] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:20:46 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:20:46.474718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:46.485446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a89d00-cf61-4393-8f14-b5342fc1741e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.490108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.490717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.490999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.491290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.492027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.493622 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.506361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1142/2286] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:20:46.507708 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:46.517825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bfb2-0f90-4ab9-a05a-4278f70f5f15 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.523395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b53f6-468b-4855-8404-865bf1f3ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.524034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b53f6-468b-4855-8404-865bf1f3ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.524341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b53f6-468b-4855-8404-865bf1f3ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.524736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b53f6-468b-4855-8404-865bf1f3ff37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.525437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b53f6-468b-4855-8404-865bf1f3ff37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.527039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b53f6-468b-4855-8404-865bf1f3ff37 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.540314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1145/2287] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:20:46.543500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:46.555093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451ac2-9f4d-4241-bb8c-86968aa4ad7a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.560538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.561219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.561499 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.561774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] PATH_INFO: `/v3/projects/9447c0a2daa2401cbf26dc5c71222207/users/6ccc455dca7242ab88ea89c0c2c07699/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.577855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9447c0a2daa2401cbf26dc5c71222207, user_id=6ccc455dca7242ab88ea89c0c2c07699, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.580870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.594280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1143/2288] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:20:46 2022] PUT /identity/v3/projects/9447c0a2daa2401cbf26dc5c71222207/users/6ccc455dca7242ab88ea89c0c2c07699/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:20:46.605365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9563-26a5-4abb-a18e-22dd05eee1e6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.605656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9563-26a5-4abb-a18e-22dd05eee1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.605934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9563-26a5-4abb-a18e-22dd05eee1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.634641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a37f9563-26a5-4abb-a18e-22dd05eee1e6 None None] MFA Rules not processed for user `6ccc455dca7242ab88ea89c0c2c07699`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:46.635894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a37f9563-26a5-4abb-a18e-22dd05eee1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:46.680322 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:46.707814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1146/2289] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:46.719675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:46.721337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:46.784072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7b3e-399b-49eb-ab04-04528057e1a9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:46.787839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a09813-c1b1-4b62-af7c-76253fdf2221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:46.788465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09813-c1b1-4b62-af7c-76253fdf2221 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:46.788753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09813-c1b1-4b62-af7c-76253fdf2221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:46.789027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09813-c1b1-4b62-af7c-76253fdf2221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:46.797541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a09813-c1b1-4b62-af7c-76253fdf2221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:46.799012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a09813-c1b1-4b62-af7c-76253fdf2221 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:46.802483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:20:46.810590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1144/2290] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:20:48.169577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:48.170053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:48.170146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:48.189208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] MFA Rules not processed for user `6ccc455dca7242ab88ea89c0c2c07699`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:48.190420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:48.197330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1147/2291] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:20:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:49.080424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2d75-cda9-4d2d-9cb7-f2db2f05185f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:49.081306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2d75-cda9-4d2d-9cb7-f2db2f05185f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:49.081741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2d75-cda9-4d2d-9cb7-f2db2f05185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:49.105262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fbdf2d75-cda9-4d2d-9cb7-f2db2f05185f None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:49.106746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fbdf2d75-cda9-4d2d-9cb7-f2db2f05185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:49.169437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1145/2292] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:20:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:49.183397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:49.184867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:49.274629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcd440-cd31-4379-944a-d1ec5bd9b3aa None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:49.281566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:49.282460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:49.282668 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:49.282818 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:49.294356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:49.296289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:49.305056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1148/2293] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:20:51.307536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14290-4970-4b77-9fb2-5ef1ee4081f9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:51.308167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14290-4970-4b77-9fb2-5ef1ee4081f9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:51.308167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14290-4970-4b77-9fb2-5ef1ee4081f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:51.328396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-13a14290-4970-4b77-9fb2-5ef1ee4081f9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:20:51.329603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-13a14290-4970-4b77-9fb2-5ef1ee4081f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:51.397730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1146/2294] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:20:51.421950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:20:51.425599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:20:51.538762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba8b1-e993-4032-b678-b34207228ea8 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:20:51.544684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:20:51.545307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:20:51.545584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:20:51.545999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:20:51.555509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:20:51.557522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:20:51.567902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1149/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:01.389249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=53 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:01.563441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=79 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:05.735303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520842c-05c9-4a98-be50-e7983f56433c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:05.735303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520842c-05c9-4a98-be50-e7983f56433c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:05.735303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520842c-05c9-4a98-be50-e7983f56433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:05.778768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-8520842c-05c9-4a98-be50-e7983f56433c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:05.780126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8520842c-05c9-4a98-be50-e7983f56433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:05.788271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1147/2296] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:05.804786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:05.806639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:05.824256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e183dff-51e4-4de5-8fe3-12921b407539 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:05.829823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:05.830431 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:05.830710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:05.830985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:05.840172 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:05.841693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:05.852178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1150/2297] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:10.950742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6cc55-04a1-4e2c-9a61-a2fc022221e5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:10.951739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6cc55-04a1-4e2c-9a61-a2fc022221e5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:10.952107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6cc55-04a1-4e2c-9a61-a2fc022221e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:10.973540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-07f6cc55-04a1-4e2c-9a61-a2fc022221e5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:10.974855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-07f6cc55-04a1-4e2c-9a61-a2fc022221e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:10.984191 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1148/2298] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:21:11.100180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:11.112807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd11b2-b549-4393-93fa-67b06a578e12 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:11.119196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:11.119828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:11.120139 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:11.120440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:11.129491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:11.131099 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:11.141955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1151/2299] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:12.500966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da203b2-13c4-4953-9834-d2f36a022f6f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:12.501474 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da203b2-13c4-4953-9834-d2f36a022f6f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:12.501746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da203b2-13c4-4953-9834-d2f36a022f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:12.524869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6da203b2-13c4-4953-9834-d2f36a022f6f None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:12.526452 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6da203b2-13c4-4953-9834-d2f36a022f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:12.534335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1149/2300] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 04:21:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:12.548133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:12.560581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ea35-3196-40b1-878a-8fe1be59598a service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:12.565752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:12.566358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:12.566640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:12.566914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:12.576023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:12.577613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:12.586205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1152/2301] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:16.172181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8711-a2ab-48ce-bdff-6823febd8c2f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:16.172661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8711-a2ab-48ce-bdff-6823febd8c2f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:16.172764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8711-a2ab-48ce-bdff-6823febd8c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:16.192273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e51a8711-a2ab-48ce-bdff-6823febd8c2f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:16.193463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e51a8711-a2ab-48ce-bdff-6823febd8c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:16.202221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1150/2302] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:16.219931 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:16.232045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4794-3fff-480c-b6fc-f728bbff0a60 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:16.237458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:16.238064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:16.238347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:16.238623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:16.247138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:16.248826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:16.258752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1153/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:21.140020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:21.140539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:21.140539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:21.165769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] MFA Rules not processed for user `4c9ce0f831564bc689839bc908be22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:21.166977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:21.226523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1151/2304] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:21:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:23.625181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:23.627456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:23.681611 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:23.683331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:23.815665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce47aa-8a5f-40bd-9c9e-b9dab7d5b4ad service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:23.834408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fac7c2-7736-4c4b-b97f-260934573a80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:23.836316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac7c2-7736-4c4b-b97f-260934573a80 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:23.836594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac7c2-7736-4c4b-b97f-260934573a80 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:23.837036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac7c2-7736-4c4b-b97f-260934573a80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:23.840611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-94fac7c2-7736-4c4b-b97f-260934573a80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:23.858406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fac7c2-7736-4c4b-b97f-260934573a80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:23.861695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fac7c2-7736-4c4b-b97f-260934573a80 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:23.862213 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2636d-62f7-4f68-8e9e-22dbd2983570 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:23.876143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:23.876807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:23.877282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:23.878396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:23.891451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1154/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:23.896119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:23.898597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:23.923105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1152/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:33.764682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4fb2-4889-4a88-83e3-609e0458db81 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:33.765201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4fb2-4889-4a88-83e3-609e0458db81 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:33.765309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4fb2-4889-4a88-83e3-609e0458db81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:33.772728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=57 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:33.786115 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6d8c4fb2-4889-4a88-83e3-609e0458db81 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:33.787358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6d8c4fb2-4889-4a88-83e3-609e0458db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:33.794981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1155/2307] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:21:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:33.818747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:33.825730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=70 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:33.832649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5dc4-3a9a-47a2-b840-d5f0479ee7e8 service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:33.838323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:33.839016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:33.839383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:33.839727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:33.848774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:33.850456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:33.859550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1153/2308] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 04:21:34.644647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47166bf2-b098-46d9-a4a2-e17f10068414 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:34.645010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47166bf2-b098-46d9-a4a2-e17f10068414 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:34.645543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47166bf2-b098-46d9-a4a2-e17f10068414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:34.688116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-47166bf2-b098-46d9-a4a2-e17f10068414 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:34.690159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-47166bf2-b098-46d9-a4a2-e17f10068414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:34.709775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1156/2309] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:34.716117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:34.729700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c021-eea3-4db6-bd7a-e0207e98fdce service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:34.749399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:34.750040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:34.750327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:34.750603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:34.761706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:34.763373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:34.776528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1154/2310] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:35.021050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d897-de73-44a1-9d03-eeca142d9934 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:35.021556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d897-de73-44a1-9d03-eeca142d9934 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:35.021811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d897-de73-44a1-9d03-eeca142d9934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:35.043514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6dd0d897-de73-44a1-9d03-eeca142d9934 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:35.044765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6dd0d897-de73-44a1-9d03-eeca142d9934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:35.052198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1157/2311] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:21:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:35.064171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:35.074812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420adaf-373b-4117-b979-3238a97d47a2 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:35.079820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:35.080425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:35.080711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:35.081018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:35.089884 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:35.091517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:35.099595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1155/2312] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:35.417005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487b45e-a24f-4c12-8379-8bf28c850c43 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:35.417291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487b45e-a24f-4c12-8379-8bf28c850c43 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:35.417562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487b45e-a24f-4c12-8379-8bf28c850c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:35.436480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f487b45e-a24f-4c12-8379-8bf28c850c43 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:35.437663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f487b45e-a24f-4c12-8379-8bf28c850c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:35.444518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1158/2313] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 04:21:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:35.456817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:35.467879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95871081-6d27-46ca-affc-09c8f894e3f9 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:35.472916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b1351-1a04-4709-9738-6afccb82eaa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:35.473732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b1351-1a04-4709-9738-6afccb82eaa6 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:35.474178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b1351-1a04-4709-9738-6afccb82eaa6 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:35.474458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b1351-1a04-4709-9738-6afccb82eaa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:35.482995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b1351-1a04-4709-9738-6afccb82eaa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:35.484605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b1351-1a04-4709-9738-6afccb82eaa6 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:35.492726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1156/2314] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:21:37.627982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487b45e-a24f-4c12-8379-8bf28c850c43 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:37.639705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487b45e-a24f-4c12-8379-8bf28c850c43 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:37.644355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:37.645064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:37.645355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:37.645635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] PATH_INFO: `/v3/users/6ccc455dca7242ab88ea89c0c2c07699` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:37.646808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccc455dca7242ab88ea89c0c2c07699)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:37.648782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:37.706166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccc455dca7242ab88ea89c0c2c07699'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:37.706829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccc455dca7242ab88ea89c0c2c07699'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:37.707480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccc455dca7242ab88ea89c0c2c07699'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:37.720800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccc455dca7242ab88ea89c0c2c07699'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:37.731769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccc455dca7242ab88ea89c0c2c07699'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:37.746688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1159/2315] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:21:37 2022] DELETE /identity/v3/users/6ccc455dca7242ab88ea89c0c2c07699 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:21:37.750849 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ae13-c7a3-448b-bdd0-e9eff0d6a300 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:37.751246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ae13-c7a3-448b-bdd0-e9eff0d6a300 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:37.751472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ae13-c7a3-448b-bdd0-e9eff0d6a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:37.771072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cdf6ae13-c7a3-448b-bdd0-e9eff0d6a300 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:37.772329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cdf6ae13-c7a3-448b-bdd0-e9eff0d6a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:37.850661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1157/2316] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:37.860493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:37.861921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:37.925294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d95c-eafc-48c0-a466-656b9a7ebf6e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:37.929606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:37.930235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:37.930824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:37.930824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:37.941010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:37.942529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:37.953808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1160/2317] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:38.171255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369089-690c-4228-9879-094da7866f7a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:38.171734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369089-690c-4228-9879-094da7866f7a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:38.172119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369089-690c-4228-9879-094da7866f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:38.234897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-17369089-690c-4228-9879-094da7866f7a None None] MFA Rules not processed for user `3e12dd63fb8c4b7e87065aba94958e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:38.236155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-17369089-690c-4228-9879-094da7866f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:38.352744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1158/2318] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:21:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:38.364567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:38.366044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:38.380755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4400-66ed-466f-9b3f-2d711c9af6ae service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:38.401359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:38.402315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:38.404875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:38.405166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] PATH_INFO: `/v3/projects/9447c0a2daa2401cbf26dc5c71222207` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:38.406688 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9447c0a2daa2401cbf26dc5c71222207)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:38.408712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:38.464481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:38.467432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9447c0a2daa2401cbf26dc5c71222207', 'request_id': 'req-99bb18a5-e12a-4729-9de0-05242eff39bb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:38.474365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9447c0a2daa2401cbf26dc5c71222207', 'request_id': 'req-99bb18a5-e12a-4729-9de0-05242eff39bb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:38.488405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9447c0a2daa2401cbf26dc5c71222207', 'request_id': 'req-99bb18a5-e12a-4729-9de0-05242eff39bb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:38.500369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] The token cache is being invalidate because project 9447c0a2daa2401cbf26dc5c71222207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:21:38.500655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:38.501299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-99bb18a5-e12a-4729-9de0-05242eff39bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:21:38.503064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1161/2319] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:21:38 2022] DELETE /identity/v3/projects/9447c0a2daa2401cbf26dc5c71222207 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:21:42.043080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:42.043656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:42.043769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:42.062921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] MFA Rules not processed for user `ce7376d180c047e2b4c8a79e260367e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:42.064149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:42.120679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:42.129043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1159/2320] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:21:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:48.497583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:21:54.344454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a0e4-8a3a-4bbf-9e59-64c2ed23bca6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:54.345130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a0e4-8a3a-4bbf-9e59-64c2ed23bca6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:54.345130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a0e4-8a3a-4bbf-9e59-64c2ed23bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:54.364822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9417a0e4-8a3a-4bbf-9e59-64c2ed23bca6 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:54.366989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9417a0e4-8a3a-4bbf-9e59-64c2ed23bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:54.425781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1162/2321] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:54.460912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:54.462301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:54.536301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e62c3-e233-4e54-8d8e-4217f65d928c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:54.541934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:54.542554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:54.542840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:54.543118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:54.551237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:54.553398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:54.563648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1160/2322] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:21:58.651194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0c17d-0769-4d3c-9a25-f97ce84c28d5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:58.651750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0c17d-0769-4d3c-9a25-f97ce84c28d5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:58.651852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0c17d-0769-4d3c-9a25-f97ce84c28d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:58.675075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-70f0c17d-0769-4d3c-9a25-f97ce84c28d5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:21:58.676341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-70f0c17d-0769-4d3c-9a25-f97ce84c28d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:58.685858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1163/2323] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:21:58.702058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:21:58.704421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:21:58.728830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e36f-7b29-4690-b630-31d330cc9a40 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:21:58.735376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:21:58.736078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:21:58.736695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:21:58.736846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:21:58.749677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:21:58.751347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:21:58.762714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1161/2324] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:22:03.888275 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb4df-fa33-4b39-ba04-bea9cbfc1f68 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:03.890624 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb4df-fa33-4b39-ba04-bea9cbfc1f68 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:03.891168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb4df-fa33-4b39-ba04-bea9cbfc1f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:03.914107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-471fb4df-fa33-4b39-ba04-bea9cbfc1f68 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:03.915479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-471fb4df-fa33-4b39-ba04-bea9cbfc1f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:03.923840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1164/2325] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:03.945983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:03.960037 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cbe8d-bbc4-43c0-be61-b187c3ae4708 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:03.966507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff52d2-5ba7-4277-b2a2-4794c3e1fa48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:03.967147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff52d2-5ba7-4277-b2a2-4794c3e1fa48 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:03.967469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff52d2-5ba7-4277-b2a2-4794c3e1fa48 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:03.967753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff52d2-5ba7-4277-b2a2-4794c3e1fa48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:03.978074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff52d2-5ba7-4277-b2a2-4794c3e1fa48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:03.979776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff52d2-5ba7-4277-b2a2-4794c3e1fa48 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:03.989973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1162/2326] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:22:05.832808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e00f-8efb-43f8-ba4d-562db7503549 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:05.833303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e00f-8efb-43f8-ba4d-562db7503549 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:05.833417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e00f-8efb-43f8-ba4d-562db7503549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:05.853024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6514e00f-8efb-43f8-ba4d-562db7503549 None None] MFA Rules not processed for user `1f21d428fab64ca68efa4cf114559ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:05.854217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6514e00f-8efb-43f8-ba4d-562db7503549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:05.907880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1165/2327] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:07.039165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1f15-e44b-4cf5-b8cf-1a7887b067c2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:07.039675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1f15-e44b-4cf5-b8cf-1a7887b067c2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:07.039758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1f15-e44b-4cf5-b8cf-1a7887b067c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:07.061307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-33da1f15-e44b-4cf5-b8cf-1a7887b067c2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:07.062627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-33da1f15-e44b-4cf5-b8cf-1a7887b067c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:07.072819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1163/2328] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:07.091098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e00f-8efb-43f8-ba4d-562db7503549 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:07.111928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e00f-8efb-43f8-ba4d-562db7503549 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:07.118829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:07.119493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:07.119778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:07.120055 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:07.129046 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:07.130651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:07.140260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1166/2329] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:22:10.235835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10c9d-a630-49b3-9686-890394c77771 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:10.236701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10c9d-a630-49b3-9686-890394c77771 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:10.237009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10c9d-a630-49b3-9686-890394c77771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:10.261923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9ec10c9d-a630-49b3-9686-890394c77771 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:10.263361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9ec10c9d-a630-49b3-9686-890394c77771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:10.272699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1164/2330] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Jul 27 04:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:10.297116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:10.310478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec162c-ebd5-46b2-b6b6-d87507a09256 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:10.316441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:10.317205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:10.317629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:10.318530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:10.328656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:10.330293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:10.342746 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1167/2331] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:22:20.255410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=52 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:20.337088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=70 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:26.781598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395900b-453f-4c92-a5a1-525f5302bcda None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:26.782061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395900b-453f-4c92-a5a1-525f5302bcda None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:26.782147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395900b-453f-4c92-a5a1-525f5302bcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:26.801705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b395900b-453f-4c92-a5a1-525f5302bcda None None] MFA Rules not processed for user `9cd6b53763844a699df2eac1918ce42d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:26.802905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b395900b-453f-4c92-a5a1-525f5302bcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:26.864751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1165/2332] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:36.857649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=25 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:41.985467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:41.986936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:42.000117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2daa9-b856-4041-a9db-30426a02a0ab service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.004694 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.005333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.005615 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.005892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] PATH_INFO: `/v3/users/3e12dd63fb8c4b7e87065aba94958e04` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.007053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e12dd63fb8c4b7e87065aba94958e04)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.009162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.054379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e12dd63fb8c4b7e87065aba94958e04'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.055096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e12dd63fb8c4b7e87065aba94958e04'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.055730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e12dd63fb8c4b7e87065aba94958e04'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.067630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e12dd63fb8c4b7e87065aba94958e04'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.074678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c4f29749-2b32-410b-95a4-7d8a883a8d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e12dd63fb8c4b7e87065aba94958e04'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.088212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1168/2333] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:22:41 2022] DELETE /identity/v3/users/3e12dd63fb8c4b7e87065aba94958e04 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:22:42.261901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395900b-453f-4c92-a5a1-525f5302bcda None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:42.274016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395900b-453f-4c92-a5a1-525f5302bcda None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.334895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.335574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.336457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.337096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] PATH_INFO: `/v3/projects/54e9db867ee64a33a34537e25c0072fd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.337940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e9db867ee64a33a34537e25c0072fd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.339952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.389513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e9db867ee64a33a34537e25c0072fd', 'request_id': 'req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.399960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e9db867ee64a33a34537e25c0072fd', 'request_id': 'req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.406234 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e9db867ee64a33a34537e25c0072fd', 'request_id': 'req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.418440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] The token cache is being invalidate because project 54e9db867ee64a33a34537e25c0072fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:22:42.418733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.419440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d3ad8a1b-84bf-4164-9770-fbc6caa7819a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:42.421476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1166/2334] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:22:42 2022] DELETE /identity/v3/projects/54e9db867ee64a33a34537e25c0072fd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:22:42.426719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef1264-36a4-46b1-a9bd-78d5434012ee None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.427208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef1264-36a4-46b1-a9bd-78d5434012ee None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.427591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef1264-36a4-46b1-a9bd-78d5434012ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.450282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a1ef1264-36a4-46b1-a9bd-78d5434012ee None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:42.452025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a1ef1264-36a4-46b1-a9bd-78d5434012ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:42.528607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1169/2335] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:42.537057 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d987-52d9-42dd-ab76-7c37dd11084c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.537396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d987-52d9-42dd-ab76-7c37dd11084c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.537676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d987-52d9-42dd-ab76-7c37dd11084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.563938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0801d987-52d9-42dd-ab76-7c37dd11084c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:42.568638 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0801d987-52d9-42dd-ab76-7c37dd11084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:42.581367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1167/2336] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:22:42.586772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef1264-36a4-46b1-a9bd-78d5434012ee None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:42.598268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef1264-36a4-46b1-a9bd-78d5434012ee None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.603680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.604306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.604681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.604918 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.605671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:22:42.605971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.607609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.620877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1170/2337] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:22:42.625539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d987-52d9-42dd-ab76-7c37dd11084c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:42.635489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d987-52d9-42dd-ab76-7c37dd11084c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.640202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.641197 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.641480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.641755 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.642428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.645943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.681465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1168/2338] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:22:42 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:22:42.686162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:42.699351 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73bfb6-46a6-4e6f-bdfe-e21fddfe0895 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.759604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.760207 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.760485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.760759 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.761428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.763394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.771131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:42.784875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1171/2339] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:22:42 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:22:42.789231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:42.799832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c9c71-6b01-4860-89c8-2828ff62e133 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.806025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.806768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.807081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.807460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.808163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.809772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.821992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1169/2340] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:22:42.826077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:42.836001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c2f53-b65a-4b3f-b9d8-d15ce9f244cd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.840634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e6b4d-0a4c-44c5-99c0-ecf2a737ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.841240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6b4d-0a4c-44c5-99c0-ecf2a737ccd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.841524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6b4d-0a4c-44c5-99c0-ecf2a737ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.841803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6b4d-0a4c-44c5-99c0-ecf2a737ccd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.842546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6b4d-0a4c-44c5-99c0-ecf2a737ccd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.844167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6b4d-0a4c-44c5-99c0-ecf2a737ccd4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.855162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1172/2341] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:22:42.859067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:42.869830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934a12b-68b2-47be-973c-79d64a8edae7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:42.874483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:42.875135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.875450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.875734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] PATH_INFO: `/v3/projects/70cb4593654f4d2bb8ef3cbf65b05112/users/e441fd58f5ac4af6a7625e70543ea42f/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.891497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cb4593654f4d2bb8ef3cbf65b05112, user_id=e441fd58f5ac4af6a7625e70543ea42f, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:42.894410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:42.907097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1170/2342] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:22:42 2022] PUT /identity/v3/projects/70cb4593654f4d2bb8ef3cbf65b05112/users/e441fd58f5ac4af6a7625e70543ea42f/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:22:42.918162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce2f4-7d4c-4790-a3ab-9bc7205913c7 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:42.918452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce2f4-7d4c-4790-a3ab-9bc7205913c7 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:42.918732 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce2f4-7d4c-4790-a3ab-9bc7205913c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:42.947677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-248ce2f4-7d4c-4790-a3ab-9bc7205913c7 None None] MFA Rules not processed for user `e441fd58f5ac4af6a7625e70543ea42f`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:42.948912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-248ce2f4-7d4c-4790-a3ab-9bc7205913c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:43.015687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1173/2343] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:43.026791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:43.028498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:43.059938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:43.091723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260875fa-9704-450c-b7ab-9bc359c31fa4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:43.095444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927142b8-e36d-46a2-b7de-b6bd445bfd1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:43.096009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927142b8-e36d-46a2-b7de-b6bd445bfd1a service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:43.096293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927142b8-e36d-46a2-b7de-b6bd445bfd1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:43.096575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927142b8-e36d-46a2-b7de-b6bd445bfd1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:43.105854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927142b8-e36d-46a2-b7de-b6bd445bfd1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:43.107316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927142b8-e36d-46a2-b7de-b6bd445bfd1a service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:43.116022 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1171/2344] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:22:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:22:53.012757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:53.112076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=14 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:53.191514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce2f4-7d4c-4790-a3ab-9bc7205913c7 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:53.217565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510725e-60fe-4b40-b742-b5e1873077ca None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:53.217853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510725e-60fe-4b40-b742-b5e1873077ca None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:53.218126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510725e-60fe-4b40-b742-b5e1873077ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:53.238534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b510725e-60fe-4b40-b742-b5e1873077ca None None] MFA Rules not processed for user `ce7376d180c047e2b4c8a79e260367e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:53.239758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b510725e-60fe-4b40-b742-b5e1873077ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:53.262179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce2f4-7d4c-4790-a3ab-9bc7205913c7 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:53.266998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:53.267660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:53.267945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:53.268210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] PATH_INFO: `/v3/users/e441fd58f5ac4af6a7625e70543ea42f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:53.269383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e441fd58f5ac4af6a7625e70543ea42f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:53.271359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:53.300256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1172/2345] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:22:53.325460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e441fd58f5ac4af6a7625e70543ea42f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.326199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e441fd58f5ac4af6a7625e70543ea42f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.326980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e441fd58f5ac4af6a7625e70543ea42f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.340647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e441fd58f5ac4af6a7625e70543ea42f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.347723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e441fd58f5ac4af6a7625e70543ea42f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.362873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1174/2346] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:22:53 2022] DELETE /identity/v3/users/e441fd58f5ac4af6a7625e70543ea42f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:22:53.367431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:53.367979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:53.368297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:53.388059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:53.389386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:53.452380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1173/2347] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:53.462602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:53.464095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:53.522743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1c1a5-c4a2-493c-8d53-f55bf0e551e2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:53.527145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741da89-ba54-4661-9e6b-f0a2af058dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:53.527823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741da89-ba54-4661-9e6b-f0a2af058dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:53.528104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741da89-ba54-4661-9e6b-f0a2af058dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:53.528375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741da89-ba54-4661-9e6b-f0a2af058dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:53.537713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741da89-ba54-4661-9e6b-f0a2af058dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:53.539155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741da89-ba54-4661-9e6b-f0a2af058dc0 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:53.549155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1175/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:22:53.832734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:53.834493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:53.850937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4549b-1e1f-4a61-b585-eb649b650f77 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:53.856512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:53.857421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:53.857813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:53.858163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] PATH_INFO: `/v3/projects/70cb4593654f4d2bb8ef3cbf65b05112` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:53.859754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cb4593654f4d2bb8ef3cbf65b05112)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:53.861883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:53.923592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cb4593654f4d2bb8ef3cbf65b05112', 'request_id': 'req-8203d095-7565-48eb-99b3-b4b87925c859'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.935720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cb4593654f4d2bb8ef3cbf65b05112', 'request_id': 'req-8203d095-7565-48eb-99b3-b4b87925c859'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.942361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cb4593654f4d2bb8ef3cbf65b05112', 'request_id': 'req-8203d095-7565-48eb-99b3-b4b87925c859'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.956830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] The token cache is being invalidate because project 70cb4593654f4d2bb8ef3cbf65b05112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:22:53.957143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.957776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8203d095-7565-48eb-99b3-b4b87925c859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:22:53.963388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1174/2349] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:22:53 2022] DELETE /identity/v3/projects/70cb4593654f4d2bb8ef3cbf65b05112 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:22:53.965033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528640cd-e916-4ab8-b415-d61eb0e59bd0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:53.965327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528640cd-e916-4ab8-b415-d61eb0e59bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:53.965607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528640cd-e916-4ab8-b415-d61eb0e59bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:53.986845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-528640cd-e916-4ab8-b415-d61eb0e59bd0 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:53.988113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-528640cd-e916-4ab8-b415-d61eb0e59bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:54.009268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:54.070017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1176/2350] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:54.078381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02af9e-5399-4bd5-8532-6098b5d5962b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.078747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02af9e-5399-4bd5-8532-6098b5d5962b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.079238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02af9e-5399-4bd5-8532-6098b5d5962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.099971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2a02af9e-5399-4bd5-8532-6098b5d5962b None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:54.101180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2a02af9e-5399-4bd5-8532-6098b5d5962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:54.109994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1175/2351] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:54.114262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528640cd-e916-4ab8-b415-d61eb0e59bd0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:54.124696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528640cd-e916-4ab8-b415-d61eb0e59bd0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:54.129716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:54.130327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.130609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.130889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.131612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:22:54.131945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:54.134583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:54.147752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1177/2352] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:22:54.152432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02af9e-5399-4bd5-8532-6098b5d5962b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:54.162723 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02af9e-5399-4bd5-8532-6098b5d5962b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:54.167435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:54.168440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.168440 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.168688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.169366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:54.171335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:54.206307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:54.218443 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1176/2353] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:22:54 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:22:54.219598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:54.231008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005195-afb8-4adf-9226-479da1c294be admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:54.294106 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:54.294726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.295107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.295354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.296068 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:54.298005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:54.320992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1178/2354] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:22:54 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:22:54.324863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:54.336464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08e383-7803-4889-8a96-cde65922325c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:54.341080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:54.341690 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.341971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.342246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.342938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:54.344563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:54.358345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1177/2355] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:22:54.359879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:54.372133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cd82-ce60-42b2-b99e-2cb00bfed447 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:54.377927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffe927-6bfb-47f2-9676-eb91e7ec21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:54.378557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffe927-6bfb-47f2-9676-eb91e7ec21c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.378841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffe927-6bfb-47f2-9676-eb91e7ec21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.379121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffe927-6bfb-47f2-9676-eb91e7ec21c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.379855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffe927-6bfb-47f2-9676-eb91e7ec21c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:54.381468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffe927-6bfb-47f2-9676-eb91e7ec21c0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:54.393947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1179/2356] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:22:54.401038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:54.411292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa485d-2e03-44b7-8e72-594f109bceb4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:54.416710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:54.417434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.417722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.418036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] PATH_INFO: `/v3/projects/661af733e7b4422fb08c81e67978cf5c/users/e1d18730d46546daac82fb20fbb07a4c/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.435740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661af733e7b4422fb08c81e67978cf5c, user_id=e1d18730d46546daac82fb20fbb07a4c, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:54.438515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:54.451986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1178/2357] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:22:54 2022] PUT /identity/v3/projects/661af733e7b4422fb08c81e67978cf5c/users/e1d18730d46546daac82fb20fbb07a4c/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:22:54.457201 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf60a-dbd2-4a6d-9c1e-49fa1cea8239 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.457863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf60a-dbd2-4a6d-9c1e-49fa1cea8239 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.458639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf60a-dbd2-4a6d-9c1e-49fa1cea8239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.481048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-15ebf60a-dbd2-4a6d-9c1e-49fa1cea8239 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:54.482268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-15ebf60a-dbd2-4a6d-9c1e-49fa1cea8239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:54.546259 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1180/2358] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:22:54.556304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:22:54.558220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:54.626533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468409b3-fe58-48b9-98b6-df00e4837c34 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:22:54.630200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0355ca-c498-4318-bf17-7396d7836e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:22:54.630820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0355ca-c498-4318-bf17-7396d7836e51 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:54.631099 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0355ca-c498-4318-bf17-7396d7836e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:54.631408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0355ca-c498-4318-bf17-7396d7836e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:54.640978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0355ca-c498-4318-bf17-7396d7836e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:22:54.642422 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0355ca-c498-4318-bf17-7396d7836e51 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:22:54.653190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1179/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:22:57.809973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d054c-099a-4928-8e08-7d0d082ab2d8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:22:57.810563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d054c-099a-4928-8e08-7d0d082ab2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:22:57.810563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d054c-099a-4928-8e08-7d0d082ab2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:22:57.833827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6f0d054c-099a-4928-8e08-7d0d082ab2d8 None None] MFA Rules not processed for user `4c9ce0f831564bc689839bc908be22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:22:57.836701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6f0d054c-099a-4928-8e08-7d0d082ab2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:22:57.869278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:22:57.906155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1181/2360] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:00.528241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3068-5082-4fcd-a643-5d2acda028bc None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:00.528893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3068-5082-4fcd-a643-5d2acda028bc None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:00.528893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3068-5082-4fcd-a643-5d2acda028bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:00.561654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a1ec3068-5082-4fcd-a643-5d2acda028bc None None] MFA Rules not processed for user `e1d18730d46546daac82fb20fbb07a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:00.562870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a1ec3068-5082-4fcd-a643-5d2acda028bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:00.642200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1180/2361] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:00.646901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d054c-099a-4928-8e08-7d0d082ab2d8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:00.666153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d054c-099a-4928-8e08-7d0d082ab2d8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:00.673144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:00.674184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:00.674772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:00.675499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:00.676816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:00.679130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:00.731736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1182/2362] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:23:00 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:23:00.735669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3068-5082-4fcd-a643-5d2acda028bc None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:00.748921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3068-5082-4fcd-a643-5d2acda028bc None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:00.806725 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:00.814325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:00.815126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:00.815860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:00.816301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:00.817331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:00.819487 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:00.847831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1181/2363] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:23:00 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:23:00.848714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:00.862328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb922a-e0fe-4fc1-a568-6b041f335696 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:00.872200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:00.872843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:00.873125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:00.873400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:00.874110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:00.875786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:00.890240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1183/2364] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:23:00.892409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:00.902866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a811b1-027d-4b48-98e1-5451c46270f2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:00.907497 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:00.908166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:00.908447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:00.908727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] PATH_INFO: `/v3/projects/6ec9208e2e184d01a9b88d6208373dae/users/f6bb071587ec48e0852f0ba51b2b4de6/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:00.925249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec9208e2e184d01a9b88d6208373dae, user_id=f6bb071587ec48e0852f0ba51b2b4de6, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:00.928004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:00.944162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1182/2365] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:23:00 2022] PUT /identity/v3/projects/6ec9208e2e184d01a9b88d6208373dae/users/f6bb071587ec48e0852f0ba51b2b4de6/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:23:00.949067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:00.959034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52236650-1dce-4904-9dfc-c24498cce02a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:01.017790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a8fb-9493-4cf6-8ad8-32f828c30eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:01.018445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a8fb-9493-4cf6-8ad8-32f828c30eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:01.018730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a8fb-9493-4cf6-8ad8-32f828c30eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:01.019009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a8fb-9493-4cf6-8ad8-32f828c30eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:01.019739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a8fb-9493-4cf6-8ad8-32f828c30eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:01.021367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a8fb-9493-4cf6-8ad8-32f828c30eb7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:01.034334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1184/2366] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:23:01.035756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:01.047109 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aa0bd-7fe1-44b2-9b71-0ec6d29bb5ed admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:01.051850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:01.052593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:01.052864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:01.053140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] PATH_INFO: `/v3/projects/6ec9208e2e184d01a9b88d6208373dae/users/f6bb071587ec48e0852f0ba51b2b4de6/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:01.055741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec9208e2e184d01a9b88d6208373dae, user_id=f6bb071587ec48e0852f0ba51b2b4de6, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:01.058460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:01.070538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1183/2367] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:23:01 2022] PUT /identity/v3/projects/6ec9208e2e184d01a9b88d6208373dae/users/f6bb071587ec48e0852f0ba51b2b4de6/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:23:07.619437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76584a76-7bff-461c-9b2b-42413103368e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:07.619897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76584a76-7bff-461c-9b2b-42413103368e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:07.620119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76584a76-7bff-461c-9b2b-42413103368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:07.659053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-76584a76-7bff-461c-9b2b-42413103368e None None] MFA Rules not processed for user `f6bb071587ec48e0852f0ba51b2b4de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:07.660731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-76584a76-7bff-461c-9b2b-42413103368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:07.764381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1185/2368] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:23:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:07.778345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:07.780180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:07.852855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085d14-d82a-425b-b960-f73b5e1bfbf8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:07.857152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:07.857792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:07.858080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:07.858386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:07.929657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:07.931400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:07.941547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1184/2369] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:08.063427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617af75-f293-427c-a310-06c4b575faa8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:08.063719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617af75-f293-427c-a310-06c4b575faa8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:08.064008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617af75-f293-427c-a310-06c4b575faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:08.083881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0617af75-f293-427c-a310-06c4b575faa8 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:08.085094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0617af75-f293-427c-a310-06c4b575faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:08.103607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:08.143571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1186/2370] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:23:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:23:08.189175 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:08.190578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:08.263861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf65c-4451-4fc2-9b35-24398fba57b3 service glance] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:08.269126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:08.269748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:08.270036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:08.270315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:08.275643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:08.279836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:08.281830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:08.290666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1185/2371] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:23:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:23:11.202687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617af75-f293-427c-a310-06c4b575faa8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:11.275828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617af75-f293-427c-a310-06c4b575faa8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:11.280426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91b02d-fa9a-4365-b874-4d75ec1156fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:11.281053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91b02d-fa9a-4365-b874-4d75ec1156fa service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:11.281339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91b02d-fa9a-4365-b874-4d75ec1156fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:11.281619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91b02d-fa9a-4365-b874-4d75ec1156fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:11.283648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3f91b02d-fa9a-4365-b874-4d75ec1156fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:11.400348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91b02d-fa9a-4365-b874-4d75ec1156fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:11.403039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91b02d-fa9a-4365-b874-4d75ec1156fa service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:11.417734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1187/2372] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:17.142619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:17.144080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:17.157179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918251-85ef-492a-babc-a6405cd213a6 service swift] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:17.162347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fad09-b177-4771-9f55-effbee68a772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:17.162963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fad09-b177-4771-9f55-effbee68a772 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:17.163298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fad09-b177-4771-9f55-effbee68a772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:17.163643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fad09-b177-4771-9f55-effbee68a772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:17.165698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ce8fad09-b177-4771-9f55-effbee68a772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:17.183077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fad09-b177-4771-9f55-effbee68a772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:17.184540 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fad09-b177-4771-9f55-effbee68a772 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:17.198971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1186/2373] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:18.125058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d3bf-47ed-4a48-910c-2d18f5bf9fa3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:18.125544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d3bf-47ed-4a48-910c-2d18f5bf9fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:18.125659 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d3bf-47ed-4a48-910c-2d18f5bf9fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:18.144660 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5a52d3bf-47ed-4a48-910c-2d18f5bf9fa3 None None] MFA Rules not processed for user `e1d18730d46546daac82fb20fbb07a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:18.145871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5a52d3bf-47ed-4a48-910c-2d18f5bf9fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:18.153512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1188/2374] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:23:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:20.042685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:20.043729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:20.044331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:20.065121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:20.066334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:20.075296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1187/2375] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:23:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:20.090326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d3bf-47ed-4a48-910c-2d18f5bf9fa3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:20.106465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d3bf-47ed-4a48-910c-2d18f5bf9fa3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:20.112309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:20.112956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:20.113232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:20.113798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:20.124135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:20.125798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:20.147399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1189/2376] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:23:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:23:30.059362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=12 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:30.138904 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=78 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:31.262459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:31.263915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:31.326289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca2645-f6e1-4689-a632-2aeaa32eed34 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:31.330223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff8e8a-4aad-4070-9dda-8ddacbddb564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:31.330920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8e8a-4aad-4070-9dda-8ddacbddb564 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:31.331287 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8e8a-4aad-4070-9dda-8ddacbddb564 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:31.331704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8e8a-4aad-4070-9dda-8ddacbddb564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:31.333741 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1aff8e8a-4aad-4070-9dda-8ddacbddb564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:31.405393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff8e8a-4aad-4070-9dda-8ddacbddb564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:31.406951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff8e8a-4aad-4070-9dda-8ddacbddb564 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:31.417218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1188/2377] 10.222.0.48 () {60 vars in 1396 bytes} [Wed Jul 27 04:23:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:32.863826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:32.865306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:32.881425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff9937-fbae-4940-b731-d5b5f5467b0c service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:32.887682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:32.888284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:32.888566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:32.888842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:32.890529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:32.949453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:32.951056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:32.960234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1190/2378] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:35.136334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64006c-f106-43cd-802d-687c35c6f84b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:35.136823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64006c-f106-43cd-802d-687c35c6f84b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:35.136916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64006c-f106-43cd-802d-687c35c6f84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:35.157141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-de64006c-f106-43cd-802d-687c35c6f84b None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:35.158353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-de64006c-f106-43cd-802d-687c35c6f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:35.166975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1189/2379] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:23:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:35.178914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:35.190724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddc147-4cd0-4ea8-96ef-7647246f5479 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:35.195630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:35.197293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:35.197573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:35.197848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:35.205983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:35.207637 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:35.216367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1191/2380] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:23:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 04:23:45.151776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=51 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:45.213222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=34 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:47.959245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64006c-f106-43cd-802d-687c35c6f84b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:47.971360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64006c-f106-43cd-802d-687c35c6f84b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:47.975464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:47.976086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:47.976937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:47.977550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:47.979490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:47.991216 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:47.995047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:48.006808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1190/2381] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:48.962617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:48.974605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585f029-6ede-431a-9b55-00cbdf6022f1 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:48.982265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:48.983191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:48.983731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:48.984232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:48.988056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:49.094456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:49.096116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:49.115341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1192/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:50.263190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:50.272068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9089f2-d033-4382-bc7f-17bb7fed2147 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:50.275977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfaec1-9ea4-41ad-aa00-e9a9ec49cbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:50.276699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfaec1-9ea4-41ad-aa00-e9a9ec49cbde service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:50.277060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfaec1-9ea4-41ad-aa00-e9a9ec49cbde service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:50.277414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfaec1-9ea4-41ad-aa00-e9a9ec49cbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:50.287437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfaec1-9ea4-41ad-aa00-e9a9ec49cbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:50.288978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfaec1-9ea4-41ad-aa00-e9a9ec49cbde service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:50.300643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1191/2383] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:53.686255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:53.709836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58520cd9-65d2-4959-8748-a50113a701b7 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:53.717402 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dba0e1-3f15-4a24-9277-fe0f6bc082b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:53.718597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba0e1-3f15-4a24-9277-fe0f6bc082b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:53.719226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba0e1-3f15-4a24-9277-fe0f6bc082b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:53.719788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba0e1-3f15-4a24-9277-fe0f6bc082b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:53.722970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-06dba0e1-3f15-4a24-9277-fe0f6bc082b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:53.735085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dba0e1-3f15-4a24-9277-fe0f6bc082b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:53.736697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dba0e1-3f15-4a24-9277-fe0f6bc082b8 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:53.753112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1193/2384] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:53.941684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d572d6-e63d-48ac-b86e-b0eda96105a3 None None] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:53.942809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d572d6-e63d-48ac-b86e-b0eda96105a3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:53.943490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d572d6-e63d-48ac-b86e-b0eda96105a3 None None] PATH_INFO: `/` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:53.945663 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1192/2385] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:23:53.957193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae764f4-a2bc-48d7-aeb1-3c862a6bc7c6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:53.957745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae764f4-a2bc-48d7-aeb1-3c862a6bc7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:53.958223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae764f4-a2bc-48d7-aeb1-3c862a6bc7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:53.981870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-fae764f4-a2bc-48d7-aeb1-3c862a6bc7c6 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:53.983043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fae764f4-a2bc-48d7-aeb1-3c862a6bc7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:53.999409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1194/2386] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:23:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:54.013600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d572d6-e63d-48ac-b86e-b0eda96105a3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:54.048031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d572d6-e63d-48ac-b86e-b0eda96105a3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:54.054481 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4d968-0f29-4810-a4c2-60614aef6cbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:54.057610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4d968-0f29-4810-a4c2-60614aef6cbf service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.058162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4d968-0f29-4810-a4c2-60614aef6cbf service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.058652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4d968-0f29-4810-a4c2-60614aef6cbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.095763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4d968-0f29-4810-a4c2-60614aef6cbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:54.102071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4d968-0f29-4810-a4c2-60614aef6cbf service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:54.117814 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1193/2387] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:54.220876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f606e-cb84-43c5-9095-169501b4a973 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.221168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f606e-cb84-43c5-9095-169501b4a973 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.221452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f606e-cb84-43c5-9095-169501b4a973 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.223107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1195/2388] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:23:54.237163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b9fe-d166-47a0-b152-aee25693683d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.237762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b9fe-d166-47a0-b152-aee25693683d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.238231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b9fe-d166-47a0-b152-aee25693683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.269083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4b18b9fe-d166-47a0-b152-aee25693683d None None] MFA Rules not processed for user `e90c842029d845bd8b4f12696354af78`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:54.270512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4b18b9fe-d166-47a0-b152-aee25693683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:54.286406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1194/2389] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:23:54.323201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18b9fe-d166-47a0-b152-aee25693683d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:54.323680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f606e-cb84-43c5-9095-169501b4a973 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:54.325893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e88f606e-cb84-43c5-9095-169501b4a973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:54.335075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18b9fe-d166-47a0-b152-aee25693683d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:54.341710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:54.342589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.343043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.343972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.360748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:54.362201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:54.373783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1195/2390] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:23:54.426088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:54.428977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:54.451167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680192d0-b003-4da1-a260-4081760ed5ff service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:54.457695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:54.458555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.458998 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.459489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] PATH_INFO: `/v3/users/9cd6b53763844a699df2eac1918ce42d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.460903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd6b53763844a699df2eac1918ce42d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:54.465970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:54.480159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f606e-cb84-43c5-9095-169501b4a973 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:54.485911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf9a3b-5854-4a41-b30b-8077b7666817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:54.486875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf9a3b-5854-4a41-b30b-8077b7666817 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.487438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf9a3b-5854-4a41-b30b-8077b7666817 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.487927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf9a3b-5854-4a41-b30b-8077b7666817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.490256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0ebf9a3b-5854-4a41-b30b-8077b7666817 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:54.513462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf9a3b-5854-4a41-b30b-8077b7666817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:54.515290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf9a3b-5854-4a41-b30b-8077b7666817 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:54.534254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1196/2391] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:54.546257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1726501-8ad7-4baf-b07b-2e61b2351596 None None] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.546484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd6b53763844a699df2eac1918ce42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:54.550014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1726501-8ad7-4baf-b07b-2e61b2351596 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.550509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1726501-8ad7-4baf-b07b-2e61b2351596 None None] PATH_INFO: `/` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.555447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1197/2392] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 04:23:54 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 04:23:54.558326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd6b53763844a699df2eac1918ce42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:54.560184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.567077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd6b53763844a699df2eac1918ce42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:54.568476 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd6b53763844a699df2eac1918ce42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:54.568961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.570486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.570918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd6b53763844a699df2eac1918ce42d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:54.600132 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1196/2393] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:23:54 2022] DELETE /identity/v3/users/9cd6b53763844a699df2eac1918ce42d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:23:54.604031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] MFA Rules not processed for user `a61ebb13ad8c483fa715e5f6906b05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:54.605489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:54.685477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:54.703340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1198/2394] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:54.717560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:54.719654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:54.845893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fceb14-798c-4c73-9586-3abb60f784c5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:54.850377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:54.852436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:54.862692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:54.863366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.863644 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.863931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.878302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:54.880567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:54.900467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1197/2395] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:23:54.949423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350163-0b08-43fe-890a-f12c7cf85775 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:54.954378 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:54.954961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:54.956220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:54.956501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] PATH_INFO: `/v3/projects/d923fa1209fa454c8c2e864dea0eb66e` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:54.957699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d923fa1209fa454c8c2e864dea0eb66e)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:54.959676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.009312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.012458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:55.033312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd923fa1209fa454c8c2e864dea0eb66e', 'request_id': 'req-193bfdeb-564e-4e8b-aa41-123f805f9a72'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:55.039905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd923fa1209fa454c8c2e864dea0eb66e', 'request_id': 'req-193bfdeb-564e-4e8b-aa41-123f805f9a72'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:55.040090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:55.053563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd923fa1209fa454c8c2e864dea0eb66e', 'request_id': 'req-193bfdeb-564e-4e8b-aa41-123f805f9a72'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:55.067813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] The token cache is being invalidate because project d923fa1209fa454c8c2e864dea0eb66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:23:55.068302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:55.069199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-193bfdeb-564e-4e8b-aa41-123f805f9a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:23:55.070961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1199/2396] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:23:54 2022] DELETE /identity/v3/projects/d923fa1209fa454c8c2e864dea0eb66e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:23:55.076234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13b833-4206-4600-8a8f-16127099e73f None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.076575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13b833-4206-4600-8a8f-16127099e73f None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.076850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13b833-4206-4600-8a8f-16127099e73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.099215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8c13b833-4206-4600-8a8f-16127099e73f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:55.100562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8c13b833-4206-4600-8a8f-16127099e73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:55.109952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a099c-8d71-4cef-8e79-78b200db06ad service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.174221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1200/2397] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:55.181836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973405-d6a7-451f-a01a-1f530f5c3141 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.182034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973405-d6a7-451f-a01a-1f530f5c3141 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.182135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973405-d6a7-451f-a01a-1f530f5c3141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.191342 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.192287 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.192648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.193005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.195003 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:55.206432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-62973405-d6a7-451f-a01a-1f530f5c3141 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:55.207676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-62973405-d6a7-451f-a01a-1f530f5c3141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:55.208937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.213215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.217468 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1201/2398] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:23:55.221448 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62973405-d6a7-451f-a01a-1f530f5c3141 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.231023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1198/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:55.231587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62973405-d6a7-451f-a01a-1f530f5c3141 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.237141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.238100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.238552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.238988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.239888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:23:55.240353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.242194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.255478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1202/2400] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:23:55.260140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.276687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb8d9-a262-4f80-af82-4422e96cdb3a service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.290886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.292558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.293056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.293492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.294366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.297539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.346418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1199/2401] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:23:55 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:23:55.350553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.370341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f03986-0474-462f-bd7b-a4483149013e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.374697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:55.464599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.466979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:55.529321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.530381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.530849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.533585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.534948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.538007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.589923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1203/2402] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:23:55 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:23:55.593563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.628725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da6f41-5be9-4ad8-b2a8-a52b98eed93f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.639722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcbc3c-1fc7-4642-9090-32e1b37b2c55 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.642977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.643934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.644449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.644953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.645774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.647535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.648218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.649001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.649215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.649504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.651729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:55.667977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.669754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.676736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1204/2403] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:23:55.680574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.685578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1200/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:55.702202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4791789-a39d-4f27-a6ef-9214549c1642 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.716559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5aff8d-5ff8-41e8-b145-374b67ea995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.717327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aff8d-5ff8-41e8-b145-374b67ea995a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.717734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aff8d-5ff8-41e8-b145-374b67ea995a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.718113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aff8d-5ff8-41e8-b145-374b67ea995a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.718935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5aff8d-5ff8-41e8-b145-374b67ea995a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.720850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5aff8d-5ff8-41e8-b145-374b67ea995a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.748080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1205/2405] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:23:55.753021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:55.770011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758088b-1470-48bc-94ef-24e8da7d539e service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:55.778170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:55.778983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.779354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.779702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] PATH_INFO: `/v3/projects/61079577947145bfb68745ca7350c507/users/94019b03194b4a1cb0fa2b8cf155ddd5/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.790775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:55.810839 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61079577947145bfb68745ca7350c507, user_id=94019b03194b4a1cb0fa2b8cf155ddd5, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:55.813773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:55.828721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1201/2406] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:23:55 2022] PUT /identity/v3/projects/61079577947145bfb68745ca7350c507/users/94019b03194b4a1cb0fa2b8cf155ddd5/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:23:55.840854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeef9a-a743-48f9-bbf5-59bd45a378fb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:55.841150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeef9a-a743-48f9-bbf5-59bd45a378fb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:55.841432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeef9a-a743-48f9-bbf5-59bd45a378fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:55.870423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-29eeef9a-a743-48f9-bbf5-59bd45a378fb None None] MFA Rules not processed for user `94019b03194b4a1cb0fa2b8cf155ddd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:55.871841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-29eeef9a-a743-48f9-bbf5-59bd45a378fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:55.938820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1206/2407] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:55.943588 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.007539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb156ae5-827f-49c6-a6f9-3c9742f156f9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.013361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.014071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.014352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.014625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.015319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.017230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.047162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1202/2408] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:23:55 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:23:56.050927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeef9a-a743-48f9-bbf5-59bd45a378fb None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.062028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeef9a-a743-48f9-bbf5-59bd45a378fb None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.139384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.140016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.140302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.140584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.141269 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.143212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.154187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:56.172077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1207/2409] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:23:56 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:23:56.178165 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.188983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157be1-8b0b-41e6-bee2-d34e48c6cc6d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.194084 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.194783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.195184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.195549 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.196323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.198186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.210934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1203/2410] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:23:56.216012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.226601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362e274-9651-4ba7-a295-c76878897d70 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.232429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.232933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.233214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.233496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] PATH_INFO: `/v3/projects/6c6957ee560744eaabb245195afc3b9a/users/5b665137b15d444cad0b45d4e8c37471/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.255580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6957ee560744eaabb245195afc3b9a, user_id=5b665137b15d444cad0b45d4e8c37471, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.258456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.273090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1208/2411] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:23:56 2022] PUT /identity/v3/projects/6c6957ee560744eaabb245195afc3b9a/users/5b665137b15d444cad0b45d4e8c37471/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:23:56.277544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.288104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601019d-3bc5-40c2-86a9-dbac8de9e4e7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.348625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75475e7-5722-4e26-9c92-af24dfe82588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.349246 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75475e7-5722-4e26-9c92-af24dfe82588 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.349532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75475e7-5722-4e26-9c92-af24dfe82588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.349806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75475e7-5722-4e26-9c92-af24dfe82588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.350501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75475e7-5722-4e26-9c92-af24dfe82588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.352158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75475e7-5722-4e26-9c92-af24dfe82588 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.362958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1204/2412] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:23:56.367210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.377503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aaa89-4262-4595-857c-b100c6b070cf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.382375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.383122 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.383492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.383837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] PATH_INFO: `/v3/projects/6c6957ee560744eaabb245195afc3b9a/users/5b665137b15d444cad0b45d4e8c37471/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.386604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6957ee560744eaabb245195afc3b9a, user_id=5b665137b15d444cad0b45d4e8c37471, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.389443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.401302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1209/2413] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:23:56 2022] PUT /identity/v3/projects/6c6957ee560744eaabb245195afc3b9a/users/5b665137b15d444cad0b45d4e8c37471/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:23:56.411501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e841-a513-4358-beaa-b344e37e07e5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.411908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e841-a513-4358-beaa-b344e37e07e5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.412257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54e841-a513-4358-beaa-b344e37e07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.443596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-cd54e841-a513-4358-beaa-b344e37e07e5 None None] MFA Rules not processed for user `5b665137b15d444cad0b45d4e8c37471`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:56.444829 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-cd54e841-a513-4358-beaa-b344e37e07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:56.491789 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:56.520987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1205/2414] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:23:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:56.532274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.533994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:56.594098 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae35d-1e67-4d08-b896-6cef1ff25d78 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.598159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.598910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.599256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.599721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.611602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.613470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.624598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1210/2415] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:56.699782 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54e841-a513-4358-beaa-b344e37e07e5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:56.709467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54e841-a513-4358-beaa-b344e37e07e5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:56.713212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84113b-f787-4a48-87d6-fe942ccc3be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:56.713822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84113b-f787-4a48-87d6-fe942ccc3be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:56.714105 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84113b-f787-4a48-87d6-fe942ccc3be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:56.714382 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84113b-f787-4a48-87d6-fe942ccc3be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:56.780436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84113b-f787-4a48-87d6-fe942ccc3be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:56.781941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84113b-f787-4a48-87d6-fe942ccc3be1 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:56.793675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1206/2416] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:57.231051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:57.304717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10fac8-d2c3-4062-9721-e2e995b06515 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:57.310680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:57.311364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:57.311651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:57.311926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:57.313863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:57.384607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:23:57.388979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:57.391242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:57.405822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1211/2417] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:23:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:23:59.303145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273a06-18e5-43a2-b64d-8695dd847f09 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:59.303685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273a06-18e5-43a2-b64d-8695dd847f09 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:59.303808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273a06-18e5-43a2-b64d-8695dd847f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:59.336298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-be273a06-18e5-43a2-b64d-8695dd847f09 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:23:59.337781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-be273a06-18e5-43a2-b64d-8695dd847f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:59.425833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1207/2418] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:23:59.441515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:23:59.443057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:23:59.548628 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa114b-cb77-48e1-abff-0a2804e363a6 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:23:59.555767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb1085-f83a-4082-abd3-e9da0023e891 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:23:59.556508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb1085-f83a-4082-abd3-e9da0023e891 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:23:59.557003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb1085-f83a-4082-abd3-e9da0023e891 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:23:59.557311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb1085-f83a-4082-abd3-e9da0023e891 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:23:59.572739 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb1085-f83a-4082-abd3-e9da0023e891 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:23:59.574795 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb1085-f83a-4082-abd3-e9da0023e891 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:23:59.584725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1212/2419] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:23:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:24:04.176024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273a06-18e5-43a2-b64d-8695dd847f09 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:04.245276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273a06-18e5-43a2-b64d-8695dd847f09 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:04.250169 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:04.250894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:04.251253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:04.251635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] PATH_INFO: `/v3/users/94019b03194b4a1cb0fa2b8cf155ddd5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:04.252907 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] RBAC: Authorizing `identity:delete_user(user_id=94019b03194b4a1cb0fa2b8cf155ddd5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:04.254885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:04.298699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:04.353856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94019b03194b4a1cb0fa2b8cf155ddd5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:04.371812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94019b03194b4a1cb0fa2b8cf155ddd5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:04.387401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94019b03194b4a1cb0fa2b8cf155ddd5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:04.401068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94019b03194b4a1cb0fa2b8cf155ddd5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:04.401325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94019b03194b4a1cb0fa2b8cf155ddd5'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:04.422435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1208/2420] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:04 2022] DELETE /identity/v3/users/94019b03194b4a1cb0fa2b8cf155ddd5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:04.427295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:04.428005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:04.428005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:04.449763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:04.450982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:04.540733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1213/2421] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:04.551726 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:04.553083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:04.617328 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee984be-c0f6-43a5-86a0-9bced8e8feed admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:04.621747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:04.622364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:04.622648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:04.622926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:04.632694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:04.634872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:04.644821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1209/2422] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:04.960947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:04.963890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:04.985604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca59e-3cf6-4122-b1bb-3811b60523d3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:04.996847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:04.997653 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:04.998010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:04.998377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] PATH_INFO: `/v3/projects/61079577947145bfb68745ca7350c507` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:04.999729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61079577947145bfb68745ca7350c507)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:05.001703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:05.065897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61079577947145bfb68745ca7350c507', 'request_id': 'req-70d5d25a-7996-401d-a6d7-ae15a00c8891'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.072357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61079577947145bfb68745ca7350c507', 'request_id': 'req-70d5d25a-7996-401d-a6d7-ae15a00c8891'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.080308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61079577947145bfb68745ca7350c507', 'request_id': 'req-70d5d25a-7996-401d-a6d7-ae15a00c8891'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.092243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] The token cache is being invalidate because project 61079577947145bfb68745ca7350c507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:05.092533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.093164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.094667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1214/2423] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:04 2022] DELETE /identity/v3/projects/61079577947145bfb68745ca7350c507 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:05.099058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:05.109458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49ff5e-45d7-4ac8-89c0-5ebaa8e367dc service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:05.166948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:05.167620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:05.167901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:05.168180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] PATH_INFO: `/v3/users/5b665137b15d444cad0b45d4e8c37471` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:05.169357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b665137b15d444cad0b45d4e8c37471)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:05.171310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:05.217009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b665137b15d444cad0b45d4e8c37471'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.219495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:05.224678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b665137b15d444cad0b45d4e8c37471'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.232496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b665137b15d444cad0b45d4e8c37471'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.233143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b665137b15d444cad0b45d4e8c37471'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.233746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17e25f4-064d-4015-b87a-70008159111d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b665137b15d444cad0b45d4e8c37471'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.252077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1210/2424] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:05 2022] DELETE /identity/v3/users/5b665137b15d444cad0b45d4e8c37471 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:05.552182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:05.553788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:05.569038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d25a-7996-401d-a6d7-ae15a00c8891 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:05.580002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:05.641621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:05.642199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:05.642481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:05.642756 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] PATH_INFO: `/v3/projects/6c6957ee560744eaabb245195afc3b9a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:05.643989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6957ee560744eaabb245195afc3b9a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:05.646072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:05.690725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6957ee560744eaabb245195afc3b9a', 'request_id': 'req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.697289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6957ee560744eaabb245195afc3b9a', 'request_id': 'req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.705816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6957ee560744eaabb245195afc3b9a', 'request_id': 'req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.720552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] The token cache is being invalidate because project 6c6957ee560744eaabb245195afc3b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:05.721141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.724825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2a32070f-45c3-4c3b-9d75-aa55483e1ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:05.726266 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1215/2425] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:05 2022] DELETE /identity/v3/projects/6c6957ee560744eaabb245195afc3b9a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:05.731833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425d8de-5f86-40d3-bec7-0dd4911a0f9d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:05.732250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425d8de-5f86-40d3-bec7-0dd4911a0f9d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:05.732613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425d8de-5f86-40d3-bec7-0dd4911a0f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:05.780762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-0425d8de-5f86-40d3-bec7-0dd4911a0f9d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:05.782161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0425d8de-5f86-40d3-bec7-0dd4911a0f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:05.863531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1211/2426] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:05.872554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f262-b6ff-4401-bf78-b598685e6427 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:05.872848 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f262-b6ff-4401-bf78-b598685e6427 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:05.873162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f262-b6ff-4401-bf78-b598685e6427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:05.895967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-be71f262-b6ff-4401-bf78-b598685e6427 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:05.897107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-be71f262-b6ff-4401-bf78-b598685e6427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:05.905334 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1216/2427] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:05.909685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425d8de-5f86-40d3-bec7-0dd4911a0f9d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:05.919667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425d8de-5f86-40d3-bec7-0dd4911a0f9d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:05.924255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:05.924863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:05.925148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:05.925427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:05.926119 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:05.926431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:05.928101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:05.940123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1212/2428] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:05.944297 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f262-b6ff-4401-bf78-b598685e6427 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:05.954412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f262-b6ff-4401-bf78-b598685e6427 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:05.959141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:05.959790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:05.960076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:05.960385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:05.961059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:05.962982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:05.989901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1217/2429] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:05 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:05.994913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.005015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649817-a036-4811-a872-a94956c3bd06 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.062034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.062637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.062918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.063192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.063885 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.065837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.086848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1213/2430] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:05 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:06.091294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.106654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20730117-c33d-47f5-9b8b-b7da431e1396 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.113413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.114392 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.114908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.115250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.116240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.119220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.135305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1218/2431] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:06.138323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.149112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13e13-29f5-4184-a2fa-89b1abfe5a42 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.154629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f19d4-0e3b-4589-b7cc-6550c3e3fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.155465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f19d4-0e3b-4589-b7cc-6550c3e3fbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.155857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f19d4-0e3b-4589-b7cc-6550c3e3fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.156242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f19d4-0e3b-4589-b7cc-6550c3e3fbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.157064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f19d4-0e3b-4589-b7cc-6550c3e3fbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.158775 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f19d4-0e3b-4589-b7cc-6550c3e3fbd2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.174001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1214/2432] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:24:06.177781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.190627 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570cd7-5831-4287-950b-72c4b76fe94d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.200232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.202517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.202815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.203815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] PATH_INFO: `/v3/projects/7b8ba85ad78d410d909dfa098af6b54f/users/47427c51a1ca4c169604c8bc4ceba9dc/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.226683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8ba85ad78d410d909dfa098af6b54f, user_id=47427c51a1ca4c169604c8bc4ceba9dc, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.230691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.269778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1219/2433] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:06 2022] PUT /identity/v3/projects/7b8ba85ad78d410d909dfa098af6b54f/users/47427c51a1ca4c169604c8bc4ceba9dc/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:06.281561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38032c6-5bd5-4e96-b4bb-003aa5b20198 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.282013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38032c6-5bd5-4e96-b4bb-003aa5b20198 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.282152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38032c6-5bd5-4e96-b4bb-003aa5b20198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.313392 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c38032c6-5bd5-4e96-b4bb-003aa5b20198 None None] MFA Rules not processed for user `47427c51a1ca4c169604c8bc4ceba9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:06.314752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c38032c6-5bd5-4e96-b4bb-003aa5b20198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:06.340484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:06.383290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1215/2434] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:06.387972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.426238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:06.450460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246f486-18d6-4c09-b7ec-7e0a87d0144e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.455081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.455718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.456001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.456284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.456953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.458860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.487343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1220/2435] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:06 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:06.490347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38032c6-5bd5-4e96-b4bb-003aa5b20198 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.504740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38032c6-5bd5-4e96-b4bb-003aa5b20198 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.567906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.568535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.568823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.569104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.569774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.571813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.598927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1216/2436] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:06 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:06.600180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.615785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaecfd-4568-41a3-839d-ec9d82397144 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.623051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.623792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.624475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.624765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.625666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.627824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.644935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.651040 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1221/2437] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:06.656990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1ff5-5e2b-498e-9ce1-c36bfe3d088c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.663660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.665345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.665778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.666063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] PATH_INFO: `/v3/projects/011dea2cfbbb4aafa43fe5c18cc32fa2/users/24b8030eb0fb42888de6215e11d7a806/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.683545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] RBAC: Authorizing `identity:create_grant(project_id=011dea2cfbbb4aafa43fe5c18cc32fa2, user_id=24b8030eb0fb42888de6215e11d7a806, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.686366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.704496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1217/2438] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:06 2022] PUT /identity/v3/projects/011dea2cfbbb4aafa43fe5c18cc32fa2/users/24b8030eb0fb42888de6215e11d7a806/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:06.708455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.719834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b4b25-7778-499f-a354-f956fa577176 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.782120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be22db1-120b-4d44-8cc0-6c6200c382df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.783003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22db1-120b-4d44-8cc0-6c6200c382df admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.783311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22db1-120b-4d44-8cc0-6c6200c382df admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.783596 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22db1-120b-4d44-8cc0-6c6200c382df admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.784294 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be22db1-120b-4d44-8cc0-6c6200c382df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.785959 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be22db1-120b-4d44-8cc0-6c6200c382df admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.796825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1222/2439] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:06.800940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.811868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95951dea-c418-4fec-be7a-550cfff4834f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:06.816381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:06.817032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.817310 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.817581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] PATH_INFO: `/v3/projects/011dea2cfbbb4aafa43fe5c18cc32fa2/users/24b8030eb0fb42888de6215e11d7a806/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.819531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] RBAC: Authorizing `identity:create_grant(project_id=011dea2cfbbb4aafa43fe5c18cc32fa2, user_id=24b8030eb0fb42888de6215e11d7a806, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:06.822736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:06.832673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1218/2440] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:06 2022] PUT /identity/v3/projects/011dea2cfbbb4aafa43fe5c18cc32fa2/users/24b8030eb0fb42888de6215e11d7a806/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:06.843433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:06.843728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:06.844010 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:06.872013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] MFA Rules not processed for user `24b8030eb0fb42888de6215e11d7a806`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:06.873292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:06.965962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1223/2441] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:06.973233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:06.975102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:07.040472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc29eba-1144-4829-b0f8-9a53fdae520f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:07.044147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:07.044768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:07.045058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:07.045337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:07.054468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:07.056535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:07.066349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1219/2442] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:07.114248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:07.115642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:07.128168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b875235-4171-49d9-82c5-2052b59c5b5b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:07.131742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2788f-308e-4fcf-ae62-d9ddbcad8e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:07.132369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2788f-308e-4fcf-ae62-d9ddbcad8e7f service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:07.132647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2788f-308e-4fcf-ae62-d9ddbcad8e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:07.132916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2788f-308e-4fcf-ae62-d9ddbcad8e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:07.161999 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:07.191012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2788f-308e-4fcf-ae62-d9ddbcad8e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:07.192478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2788f-308e-4fcf-ae62-d9ddbcad8e7f service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:07.201389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1224/2443] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:10.812858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:10.831692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:10.876386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324ca61-3887-4800-98aa-5eec1b5cc319 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:10.880952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:10.881590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:10.881875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:10.882156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] PATH_INFO: `/v3/users/47427c51a1ca4c169604c8bc4ceba9dc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:10.883567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47427c51a1ca4c169604c8bc4ceba9dc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:10.885442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:10.930597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47427c51a1ca4c169604c8bc4ceba9dc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:10.937690 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47427c51a1ca4c169604c8bc4ceba9dc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:10.944670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47427c51a1ca4c169604c8bc4ceba9dc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:10.945308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47427c51a1ca4c169604c8bc4ceba9dc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:10.946418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47427c51a1ca4c169604c8bc4ceba9dc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:10.963941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1220/2444] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:10 2022] DELETE /identity/v3/users/47427c51a1ca4c169604c8bc4ceba9dc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:10.968473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:10.968969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:10.969067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:10.988922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:10.990263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:11.052730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1225/2445] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:11.065060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:11.066532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:11.125847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0760-d0b4-4bc7-a180-b0664e4fb40e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:11.129464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:11.130073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:11.130353 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:11.130627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:11.140532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:11.141953 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:11.151597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1221/2446] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:11.428014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:11.429469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:11.442149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbc5ca-f496-4e6a-84c1-ae9a39232cf8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:11.447467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:11.448751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:11.449038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:11.449538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] PATH_INFO: `/v3/projects/7b8ba85ad78d410d909dfa098af6b54f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:11.450761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8ba85ad78d410d909dfa098af6b54f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:11.453841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:11.505001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8ba85ad78d410d909dfa098af6b54f', 'request_id': 'req-86fc80b8-5122-4269-8e8a-f644d7d8752e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.510470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8ba85ad78d410d909dfa098af6b54f', 'request_id': 'req-86fc80b8-5122-4269-8e8a-f644d7d8752e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.517981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8ba85ad78d410d909dfa098af6b54f', 'request_id': 'req-86fc80b8-5122-4269-8e8a-f644d7d8752e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.529257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] The token cache is being invalidate because project 7b8ba85ad78d410d909dfa098af6b54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:11.529550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.530191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.531749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1226/2447] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:11 2022] DELETE /identity/v3/projects/7b8ba85ad78d410d909dfa098af6b54f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:11.536377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:11.546647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cedfa-a880-4239-9d9e-7586a43dc5f3 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:11.586172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:11.605276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:11.605952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:11.606248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:11.606618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] PATH_INFO: `/v3/users/24b8030eb0fb42888de6215e11d7a806` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:11.607779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b8030eb0fb42888de6215e11d7a806)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:11.609857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:11.659699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b8030eb0fb42888de6215e11d7a806'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.669772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b8030eb0fb42888de6215e11d7a806'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.676964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b8030eb0fb42888de6215e11d7a806'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.677636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b8030eb0fb42888de6215e11d7a806'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.678242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-75f960d1-c4bd-44ed-80e4-fcfe949f0660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b8030eb0fb42888de6215e11d7a806'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:11.697347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1222/2448] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:11 2022] DELETE /identity/v3/users/24b8030eb0fb42888de6215e11d7a806 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:11.981982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:11.983497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:11.997813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc80b8-5122-4269-8e8a-f644d7d8752e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.047471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:12.058243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.058889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.059179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.059502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] PATH_INFO: `/v3/projects/011dea2cfbbb4aafa43fe5c18cc32fa2` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.060702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011dea2cfbbb4aafa43fe5c18cc32fa2)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.062675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.109458 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011dea2cfbbb4aafa43fe5c18cc32fa2', 'request_id': 'req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:12.114957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011dea2cfbbb4aafa43fe5c18cc32fa2', 'request_id': 'req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:12.122455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011dea2cfbbb4aafa43fe5c18cc32fa2', 'request_id': 'req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:12.134290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] The token cache is being invalidate because project 011dea2cfbbb4aafa43fe5c18cc32fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:12.134585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:12.135229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bf6ed07c-2c0a-490a-9744-a7ef12bb8d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:12.136763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1227/2449] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:11 2022] DELETE /identity/v3/projects/011dea2cfbbb4aafa43fe5c18cc32fa2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:12.141972 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4929-fc3b-4fe6-a366-379b27ce2398 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.142433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4929-fc3b-4fe6-a366-379b27ce2398 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.142641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4929-fc3b-4fe6-a366-379b27ce2398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.165282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-716b4929-fc3b-4fe6-a366-379b27ce2398 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:12.166593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-716b4929-fc3b-4fe6-a366-379b27ce2398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:12.229387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1223/2450] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:12.237211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf8602-4fa6-4ef4-a123-17f86d604249 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.237497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf8602-4fa6-4ef4-a123-17f86d604249 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.237772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf8602-4fa6-4ef4-a123-17f86d604249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.261834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1bbf8602-4fa6-4ef4-a123-17f86d604249 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:12.263050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1bbf8602-4fa6-4ef4-a123-17f86d604249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:12.272138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1228/2451] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:12.277315 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4929-fc3b-4fe6-a366-379b27ce2398 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.290864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4929-fc3b-4fe6-a366-379b27ce2398 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.296092 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.296714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.297009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.297273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.297973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:12.298287 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.299999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.312705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1224/2452] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:12.317041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf8602-4fa6-4ef4-a123-17f86d604249 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.326023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf8602-4fa6-4ef4-a123-17f86d604249 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.330568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.331160 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.331465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.331738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.332400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.334277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.360935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1229/2453] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:12 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:12.364901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.375753 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf442-83bc-4caf-9304-fd6be4c5b58d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.418550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:12.433458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.434056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.434336 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.434617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.435373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.437301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.456888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1225/2454] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:12 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:12.461008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.471969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a80d-6af0-4ac4-9180-d39a1fc97ac6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.476469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.477597 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.478417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.478698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.479412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.481009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.491250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1230/2455] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:12.495802 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.505713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e8ed-475f-4666-9642-449d8939b39d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.510432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283cfb0-e8e9-46c4-a14e-e9d1a581555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.511034 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283cfb0-e8e9-46c4-a14e-e9d1a581555e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.511352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283cfb0-e8e9-46c4-a14e-e9d1a581555e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.511634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283cfb0-e8e9-46c4-a14e-e9d1a581555e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.512326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283cfb0-e8e9-46c4-a14e-e9d1a581555e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.513911 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283cfb0-e8e9-46c4-a14e-e9d1a581555e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.524976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1226/2456] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:12.529197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.539022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eed06-1715-428a-a516-0381ea9e78ae admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.544313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.544965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.545244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.545516 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] PATH_INFO: `/v3/projects/ce62ccd9a2564528a6bd954f7346b5d3/users/d3c2ca897cd44a9289ea0aaea7a389a5/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.559719 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce62ccd9a2564528a6bd954f7346b5d3, user_id=d3c2ca897cd44a9289ea0aaea7a389a5, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.562428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.575675 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1231/2457] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:12 2022] PUT /identity/v3/projects/ce62ccd9a2564528a6bd954f7346b5d3/users/d3c2ca897cd44a9289ea0aaea7a389a5/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:12.587623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc7f27-c1f0-422e-972e-6c5856472575 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.587916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc7f27-c1f0-422e-972e-6c5856472575 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.588218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc7f27-c1f0-422e-972e-6c5856472575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.615947 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f0fc7f27-c1f0-422e-972e-6c5856472575 None None] MFA Rules not processed for user `d3c2ca897cd44a9289ea0aaea7a389a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:12.617089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f0fc7f27-c1f0-422e-972e-6c5856472575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:12.680271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1227/2458] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:12.684905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.749290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4e154-e102-483b-b29c-9bcd9c8c2797 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.753992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.754736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.755018 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.755329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.755989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.757963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.785215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1232/2459] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:12 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:12.789464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc7f27-c1f0-422e-972e-6c5856472575 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.801141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc7f27-c1f0-422e-972e-6c5856472575 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.859498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.860131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.860430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.860685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.861351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.863289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.892732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1228/2460] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:12 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:12.895088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.902474 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:12.906559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ee59-0a75-4636-88a0-4f12c0950a47 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.912514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.913268 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.913775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.914057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.914876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.916608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.927184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1233/2461] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:12.932015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.941860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42455a-477d-474f-a4ea-6fda531e385a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:12.947253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:12.947936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:12.948220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:12.948498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] PATH_INFO: `/v3/projects/4645b9a9b24d4011ae2074253823f532/users/b2acc06cd74649dbae15ac12d7a857cb/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:12.963959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4645b9a9b24d4011ae2074253823f532, user_id=b2acc06cd74649dbae15ac12d7a857cb, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:12.966893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:12.984512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1229/2462] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:12 2022] PUT /identity/v3/projects/4645b9a9b24d4011ae2074253823f532/users/b2acc06cd74649dbae15ac12d7a857cb/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:12.988570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:12.998712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631cfd1-2db1-4df4-ab63-2b5f1af13102 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:13.054550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d572a-ae94-4848-aac8-e4e27fa8dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:13.055163 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d572a-ae94-4848-aac8-e4e27fa8dfbd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:13.055935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d572a-ae94-4848-aac8-e4e27fa8dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:13.055935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d572a-ae94-4848-aac8-e4e27fa8dfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:13.056646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d572a-ae94-4848-aac8-e4e27fa8dfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:13.058244 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d572a-ae94-4848-aac8-e4e27fa8dfbd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:13.067875 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1234/2463] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:13.072574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:13.082743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbce24-b48b-4265-8e5a-eba060474451 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:13.088137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:13.088812 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:13.089094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:13.089369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] PATH_INFO: `/v3/projects/4645b9a9b24d4011ae2074253823f532/users/b2acc06cd74649dbae15ac12d7a857cb/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:13.091386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4645b9a9b24d4011ae2074253823f532, user_id=b2acc06cd74649dbae15ac12d7a857cb, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:13.094177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:13.104869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1230/2464] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:13 2022] PUT /identity/v3/projects/4645b9a9b24d4011ae2074253823f532/users/b2acc06cd74649dbae15ac12d7a857cb/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:13.115110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6f7f-981f-4a83-b87f-82eecb5763f3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:13.115432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6f7f-981f-4a83-b87f-82eecb5763f3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:13.115826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6f7f-981f-4a83-b87f-82eecb5763f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:13.144426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2dfb6f7f-981f-4a83-b87f-82eecb5763f3 None None] MFA Rules not processed for user `b2acc06cd74649dbae15ac12d7a857cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:13.145565 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2dfb6f7f-981f-4a83-b87f-82eecb5763f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:13.212187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1235/2465] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:13.223465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:13.225230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:13.235748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:13.284981 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f497-64bc-46d8-8471-7aa7dff1bf57 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:13.288712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe69d03-38ef-4ded-9cb7-f830328c912f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:13.289759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69d03-38ef-4ded-9cb7-f830328c912f service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:13.289759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69d03-38ef-4ded-9cb7-f830328c912f service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:13.289955 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69d03-38ef-4ded-9cb7-f830328c912f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:13.299367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69d03-38ef-4ded-9cb7-f830328c912f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:13.300811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69d03-38ef-4ded-9cb7-f830328c912f service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:13.311193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1231/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:13.341577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb6f7f-981f-4a83-b87f-82eecb5763f3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:13.408811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb6f7f-981f-4a83-b87f-82eecb5763f3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:13.413350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:13.413988 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:13.414271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:13.414598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] PATH_INFO: `/v3/users/d3c2ca897cd44a9289ea0aaea7a389a5` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:13.415908 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c2ca897cd44a9289ea0aaea7a389a5)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:13.417846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:13.434589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:13.468408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c2ca897cd44a9289ea0aaea7a389a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:13.469077 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c2ca897cd44a9289ea0aaea7a389a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:13.469753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c2ca897cd44a9289ea0aaea7a389a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:13.482315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c2ca897cd44a9289ea0aaea7a389a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:13.489447 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c2ca897cd44a9289ea0aaea7a389a5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:13.503035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1236/2467] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:13 2022] DELETE /identity/v3/users/d3c2ca897cd44a9289ea0aaea7a389a5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:13.507441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:13.507733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:13.508013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:13.527438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:13.528667 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:13.586427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1232/2468] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:13.595958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:13.597697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:13.654930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1d291-882c-4ed1-9c5c-07dc4c37aee2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:13.658638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:13.659323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:13.659568 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:13.659846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:13.669462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:13.670912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:13.680969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1237/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:13.979072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:13.980583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:13.993764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007870c-3268-4b88-ae51-635ba9e678c4 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:13.999112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:13.999795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:14.000075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:14.000348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] PATH_INFO: `/v3/projects/ce62ccd9a2564528a6bd954f7346b5d3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:14.001550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce62ccd9a2564528a6bd954f7346b5d3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:14.003507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:14.055841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce62ccd9a2564528a6bd954f7346b5d3', 'request_id': 'req-a495a370-3d2b-4d49-9b94-e085168ad97c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.063871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce62ccd9a2564528a6bd954f7346b5d3', 'request_id': 'req-a495a370-3d2b-4d49-9b94-e085168ad97c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.081190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce62ccd9a2564528a6bd954f7346b5d3', 'request_id': 'req-a495a370-3d2b-4d49-9b94-e085168ad97c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.082230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] The token cache is being invalidate because project ce62ccd9a2564528a6bd954f7346b5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:14.082528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.083178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.084713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1233/2470] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:13 2022] DELETE /identity/v3/projects/ce62ccd9a2564528a6bd954f7346b5d3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:14.089761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:14.099744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858afb3-d30c-4d8f-bf0e-b191e4a7772a service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:14.154975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:14.155638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:14.155922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:14.156198 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] PATH_INFO: `/v3/users/b2acc06cd74649dbae15ac12d7a857cb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:14.157357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2acc06cd74649dbae15ac12d7a857cb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:14.159310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:14.199990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:14.206749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2acc06cd74649dbae15ac12d7a857cb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.207692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2acc06cd74649dbae15ac12d7a857cb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.208452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2acc06cd74649dbae15ac12d7a857cb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.220602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2acc06cd74649dbae15ac12d7a857cb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.228088 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-89248628-2c77-4c5c-9a15-0299fe58725e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2acc06cd74649dbae15ac12d7a857cb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.240216 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1238/2471] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:14 2022] DELETE /identity/v3/users/b2acc06cd74649dbae15ac12d7a857cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:14.519599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:14.521058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:14.536889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495a370-3d2b-4d49-9b94-e085168ad97c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:14.581083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:14.622634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:14.622979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:14.623399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:14.623750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] PATH_INFO: `/v3/projects/4645b9a9b24d4011ae2074253823f532` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:14.625026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4645b9a9b24d4011ae2074253823f532)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:14.627399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:14.695658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4645b9a9b24d4011ae2074253823f532', 'request_id': 'req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.705059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4645b9a9b24d4011ae2074253823f532', 'request_id': 'req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.711067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4645b9a9b24d4011ae2074253823f532', 'request_id': 'req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.723826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] The token cache is being invalidate because project 4645b9a9b24d4011ae2074253823f532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:14.724218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.724873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-74c3e1d0-81cb-4fb9-84f1-34a79f2c749b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:14.726496 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1234/2472] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:14 2022] DELETE /identity/v3/projects/4645b9a9b24d4011ae2074253823f532 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:14.731594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10efec-ebab-4db2-acd9-661c0ed2f7f3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:14.731912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10efec-ebab-4db2-acd9-661c0ed2f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:14.732218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10efec-ebab-4db2-acd9-661c0ed2f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:14.751740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-de10efec-ebab-4db2-acd9-661c0ed2f7f3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:14.752895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-de10efec-ebab-4db2-acd9-661c0ed2f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:14.811632 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1239/2473] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:14.820449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628441c-8b77-46da-8e7f-8851e1054b58 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:14.821360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628441c-8b77-46da-8e7f-8851e1054b58 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:14.821642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628441c-8b77-46da-8e7f-8851e1054b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:14.840986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-5628441c-8b77-46da-8e7f-8851e1054b58 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:14.842179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5628441c-8b77-46da-8e7f-8851e1054b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:14.850309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1235/2474] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:14.854556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10efec-ebab-4db2-acd9-661c0ed2f7f3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:14.864191 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10efec-ebab-4db2-acd9-661c0ed2f7f3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:14.869397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:14.869998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:14.870276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:14.870547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:14.871233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:14.871577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:14.873168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:14.885325 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1240/2475] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:14.889396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628441c-8b77-46da-8e7f-8851e1054b58 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:14.898544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628441c-8b77-46da-8e7f-8851e1054b58 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:14.903147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:14.903780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:14.904063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:14.904339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:14.905001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:14.906919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:14.934028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1236/2476] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:14 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:14.938312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:14.949551 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257ea02-c905-4870-b548-b908aee5f41f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.006687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.007220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.007535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.007811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.008932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.010966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.031966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1241/2477] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:14 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:15.036162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.046961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116582-f334-401d-990e-a22cb46a85ed admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.051504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57479419-4632-4054-a898-fe483e785215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.052103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479419-4632-4054-a898-fe483e785215 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.052381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479419-4632-4054-a898-fe483e785215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.052656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479419-4632-4054-a898-fe483e785215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.053338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57479419-4632-4054-a898-fe483e785215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.054928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57479419-4632-4054-a898-fe483e785215 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.064948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1237/2478] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:15.068850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.078748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e2522-e1ab-4d5a-8618-9af89e9d4bd6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.083305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc91b0f-fd34-4aa7-b911-d0f566f5c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.083909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc91b0f-fd34-4aa7-b911-d0f566f5c355 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.084190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc91b0f-fd34-4aa7-b911-d0f566f5c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.084466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc91b0f-fd34-4aa7-b911-d0f566f5c355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.085181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc91b0f-fd34-4aa7-b911-d0f566f5c355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.087653 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc91b0f-fd34-4aa7-b911-d0f566f5c355 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.098636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1242/2479] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:15.103504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57479419-4632-4054-a898-fe483e785215 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.113519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57479419-4632-4054-a898-fe483e785215 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.118438 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.119206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.119663 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.119942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] PATH_INFO: `/v3/projects/2bb6008f31844a05bc71ad491b38fafb/users/899bc8da6a22402199dd468f06060d4c/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.135879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb6008f31844a05bc71ad491b38fafb, user_id=899bc8da6a22402199dd468f06060d4c, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.138618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.152697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1238/2480] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:15 2022] PUT /identity/v3/projects/2bb6008f31844a05bc71ad491b38fafb/users/899bc8da6a22402199dd468f06060d4c/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:15.162964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ecf2-8a90-4bfd-a8f7-65934603418e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.163245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ecf2-8a90-4bfd-a8f7-65934603418e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.163581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ecf2-8a90-4bfd-a8f7-65934603418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.190643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d155ecf2-8a90-4bfd-a8f7-65934603418e None None] MFA Rules not processed for user `899bc8da6a22402199dd468f06060d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:15.191981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d155ecf2-8a90-4bfd-a8f7-65934603418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:15.202004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:15.261406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1243/2481] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:15.265746 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.326363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bd5d-3ce0-41c5-ae4c-de7e9c6bf30e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.330961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.331597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.331880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.332155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.332811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.334713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.339402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:15.364584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1239/2482] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:15 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:15.367376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155ecf2-8a90-4bfd-a8f7-65934603418e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.379058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155ecf2-8a90-4bfd-a8f7-65934603418e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.435560 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.436185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.436471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.436749 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.437424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.439379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.463440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1244/2483] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:15 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:15.467244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.478525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68614113-504c-4ca6-9c35-d376401a738c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.483096 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.483736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.484020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.484293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.484986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.486724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.497629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1240/2484] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:15.501958 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.512459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bfbd3-f867-4a72-96a7-5625ffc4e98e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.517033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.517689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.517972 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.518251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] PATH_INFO: `/v3/projects/daa5b7daf4394e988b9d89f3109a3f97/users/21ca681401764ea7ad0eaad4f08965c7/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.533291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa5b7daf4394e988b9d89f3109a3f97, user_id=21ca681401764ea7ad0eaad4f08965c7, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.536033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.548977 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1245/2485] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:15 2022] PUT /identity/v3/projects/daa5b7daf4394e988b9d89f3109a3f97/users/21ca681401764ea7ad0eaad4f08965c7/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:15.553107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.563282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c669-2587-484b-bf4a-a41509255dc8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.620270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9da446-e7d5-400b-ab3d-70c41af86ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.620883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9da446-e7d5-400b-ab3d-70c41af86ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.621161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9da446-e7d5-400b-ab3d-70c41af86ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.621434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9da446-e7d5-400b-ab3d-70c41af86ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.622118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9da446-e7d5-400b-ab3d-70c41af86ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.623769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9da446-e7d5-400b-ab3d-70c41af86ebd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.633522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1241/2486] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:15.637704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.647884 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec676-ec91-44bc-bd05-6ace5713c00f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.652991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.653641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.653923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.654196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] PATH_INFO: `/v3/projects/daa5b7daf4394e988b9d89f3109a3f97/users/21ca681401764ea7ad0eaad4f08965c7/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.656228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa5b7daf4394e988b9d89f3109a3f97, user_id=21ca681401764ea7ad0eaad4f08965c7, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.658892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.668956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1246/2487] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:15 2022] PUT /identity/v3/projects/daa5b7daf4394e988b9d89f3109a3f97/users/21ca681401764ea7ad0eaad4f08965c7/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:15.679130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552497a1-681b-491c-a691-fda737325259 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.679458 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552497a1-681b-491c-a691-fda737325259 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.679736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552497a1-681b-491c-a691-fda737325259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.710992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-552497a1-681b-491c-a691-fda737325259 None None] MFA Rules not processed for user `21ca681401764ea7ad0eaad4f08965c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:15.712987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-552497a1-681b-491c-a691-fda737325259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:15.793041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1242/2488] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:15.804804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:15.807945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:15.900640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418679c6-028e-403c-bf5e-922a558c2b08 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:15.906352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5221d-b154-44e4-afd0-ede7fd19cd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:15.906982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5221d-b154-44e4-afd0-ede7fd19cd8b service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:15.907282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5221d-b154-44e4-afd0-ede7fd19cd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:15.907695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5221d-b154-44e4-afd0-ede7fd19cd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:15.919472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5221d-b154-44e4-afd0-ede7fd19cd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:15.921806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5221d-b154-44e4-afd0-ede7fd19cd8b service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:15.945538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1247/2489] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:16.110020 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552497a1-681b-491c-a691-fda737325259 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:16.171178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:16.177448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552497a1-681b-491c-a691-fda737325259 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:16.183404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:16.184049 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:16.184331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:16.184608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] PATH_INFO: `/v3/users/899bc8da6a22402199dd468f06060d4c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:16.185767 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899bc8da6a22402199dd468f06060d4c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:16.187825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:16.240952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899bc8da6a22402199dd468f06060d4c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:16.248267 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899bc8da6a22402199dd468f06060d4c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:16.257398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899bc8da6a22402199dd468f06060d4c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:16.259900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899bc8da6a22402199dd468f06060d4c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:16.260521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899bc8da6a22402199dd468f06060d4c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:16.286987 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1243/2490] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:16 2022] DELETE /identity/v3/users/899bc8da6a22402199dd468f06060d4c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:16.292037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:16.292549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:16.292916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:16.308878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:16.316820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:16.318755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:16.399318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1248/2491] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:16.408417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:16.410282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:16.510415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c575-5c2b-4605-b0c5-1db838627bf9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:16.526043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:16.526963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:16.527427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:16.527848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:16.548432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:16.549913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:16.575882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1244/2492] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:16.954415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:16.955879 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:16.980693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ce4c3-b847-4f33-9edf-7808fa6469c4 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:16.999129 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:17.000195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:17.000689 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:17.001208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] PATH_INFO: `/v3/projects/2bb6008f31844a05bc71ad491b38fafb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:17.003179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb6008f31844a05bc71ad491b38fafb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:17.006613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:17.090469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb6008f31844a05bc71ad491b38fafb', 'request_id': 'req-18e2a541-e53b-454f-9c46-e58b51004278'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.098731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb6008f31844a05bc71ad491b38fafb', 'request_id': 'req-18e2a541-e53b-454f-9c46-e58b51004278'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.109485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb6008f31844a05bc71ad491b38fafb', 'request_id': 'req-18e2a541-e53b-454f-9c46-e58b51004278'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.132058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] The token cache is being invalidate because project 2bb6008f31844a05bc71ad491b38fafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:17.132720 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.134507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.136190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1249/2493] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:16 2022] DELETE /identity/v3/projects/2bb6008f31844a05bc71ad491b38fafb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:17.140174 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:17.150227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf808c3-9643-47d5-a917-3a87337c76a1 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:17.206040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:17.206679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:17.206959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:17.207239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] PATH_INFO: `/v3/users/21ca681401764ea7ad0eaad4f08965c7` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:17.208448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ca681401764ea7ad0eaad4f08965c7)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:17.210412 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:17.230734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:17.255992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ca681401764ea7ad0eaad4f08965c7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.263637 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ca681401764ea7ad0eaad4f08965c7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.270435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ca681401764ea7ad0eaad4f08965c7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.271062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ca681401764ea7ad0eaad4f08965c7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.271739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ca681401764ea7ad0eaad4f08965c7'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.288525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1245/2494] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:17 2022] DELETE /identity/v3/users/21ca681401764ea7ad0eaad4f08965c7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:17.840349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:17.841939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:17.857067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a541-e53b-454f-9c46-e58b51004278 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:17.914989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:17.915695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:17.915838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:17.916177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] PATH_INFO: `/v3/projects/daa5b7daf4394e988b9d89f3109a3f97` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:17.917289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa5b7daf4394e988b9d89f3109a3f97)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:17.919209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:17.953318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:17.954892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:17.959284 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:17.984740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa5b7daf4394e988b9d89f3109a3f97', 'request_id': 'req-cdd4a814-cfde-4472-a7b2-95d035495460'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:17.991221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa5b7daf4394e988b9d89f3109a3f97', 'request_id': 'req-cdd4a814-cfde-4472-a7b2-95d035495460'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:18.000748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa5b7daf4394e988b9d89f3109a3f97', 'request_id': 'req-cdd4a814-cfde-4472-a7b2-95d035495460'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:18.018755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] The token cache is being invalidate because project daa5b7daf4394e988b9d89f3109a3f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:18.019484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:18.020809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cdd4a814-cfde-4472-a7b2-95d035495460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:18.023171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1250/2495] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:17 2022] DELETE /identity/v3/projects/daa5b7daf4394e988b9d89f3109a3f97 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:18.031361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df4ab-2c70-4d61-beb6-56c214ad035b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.031909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df4ab-2c70-4d61-beb6-56c214ad035b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.032197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df4ab-2c70-4d61-beb6-56c214ad035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.053300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7e9df4ab-2c70-4d61-beb6-56c214ad035b None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:18.054533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7e9df4ab-2c70-4d61-beb6-56c214ad035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:18.088062 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb91573-5a8a-4f82-81f5-6387ec86bb8f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.121441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1251/2496] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:18.136686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db187df6-6c97-4048-bf30-00a43d90b4c2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.137125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db187df6-6c97-4048-bf30-00a43d90b4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.137508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db187df6-6c97-4048-bf30-00a43d90b4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.163429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-db187df6-6c97-4048-bf30-00a43d90b4c2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:18.163429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-db187df6-6c97-4048-bf30-00a43d90b4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:18.172997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.173634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.173919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.174194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.176027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:18.181263 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1252/2497] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:18.188250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db187df6-6c97-4048-bf30-00a43d90b4c2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.188699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.190410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.198963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db187df6-6c97-4048-bf30-00a43d90b4c2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.203762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.204171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1246/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:18.204372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.204654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.204929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.206362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:18.206672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.208333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.226265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1253/2499] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:18.231317 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.247722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e383aa1-577a-46ce-9e28-6710f0d3c638 service nova] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.253589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.254286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.254639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.255004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.256339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.257830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.285016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:18.298901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1247/2500] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:18.303162 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.315664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a59e11-ba6b-4b64-b2ca-717351d7433c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.401119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.401747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.402030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.402306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.403158 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.404970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.431846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1254/2501] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:18 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:18.432943 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.442993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3e8dd-c19c-4842-b1da-f2b3d185ebbd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.448258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.448871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.449146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.449416 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.450103 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.451818 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.463945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1248/2502] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:18.468057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.478404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7695126-d975-49a4-ad89-7ee06be04388 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.483707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a92f33-cc28-4103-bb5b-63244efcd146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.484320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a92f33-cc28-4103-bb5b-63244efcd146 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.484635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a92f33-cc28-4103-bb5b-63244efcd146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.484913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a92f33-cc28-4103-bb5b-63244efcd146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.485612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a92f33-cc28-4103-bb5b-63244efcd146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.487227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a92f33-cc28-4103-bb5b-63244efcd146 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.499371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1255/2503] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:18.503238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.513870 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ce6cb-3433-4e97-8b20-9eb8659ccdae admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.518766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.519432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.519710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.519980 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] PATH_INFO: `/v3/projects/ca74e880a25d41c3baae5bb6fae05d05/users/851b4defd9584a7c97ddf9a9b4560e54/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.534992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca74e880a25d41c3baae5bb6fae05d05, user_id=851b4defd9584a7c97ddf9a9b4560e54, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.537729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.552128 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1249/2504] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:18 2022] PUT /identity/v3/projects/ca74e880a25d41c3baae5bb6fae05d05/users/851b4defd9584a7c97ddf9a9b4560e54/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:18.563620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f981ad-be28-4174-8ef0-1d8047e4ef30 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.563993 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f981ad-be28-4174-8ef0-1d8047e4ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.564335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f981ad-be28-4174-8ef0-1d8047e4ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.599578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-86f981ad-be28-4174-8ef0-1d8047e4ef30 None None] MFA Rules not processed for user `851b4defd9584a7c97ddf9a9b4560e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:18.600832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-86f981ad-be28-4174-8ef0-1d8047e4ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:18.609842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:18.670323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1256/2505] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:18.674891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.739064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da3e69-a61e-41d7-99f2-f79b6cbc4e55 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.749776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.750425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.750711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.750989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.751699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.753639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.786564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1250/2506] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:18.791100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f981ad-be28-4174-8ef0-1d8047e4ef30 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.803185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f981ad-be28-4174-8ef0-1d8047e4ef30 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.871235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.872058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.872169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.872433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.873119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.875134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.901846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1257/2507] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:18 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:18.905661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.918078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646a0da-8b14-4a4b-aea1-0c1158a0f5cd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.923097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.923783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.924072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.924351 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.925065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.927036 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:18.940686 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1251/2508] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:18.955547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:18.967038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9dc39-6ffd-4d69-9dde-6ce210724b58 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:18.972379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:18.973166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:18.973522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:18.973874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] PATH_INFO: `/v3/projects/8f8d8921f5924226bd0dfa54e42e65f3/users/61f2629aa8234cda8e05557ddf2e85eb/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:18.991222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8d8921f5924226bd0dfa54e42e65f3, user_id=61f2629aa8234cda8e05557ddf2e85eb, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:18.994205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:19.011960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1258/2509] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:18 2022] PUT /identity/v3/projects/8f8d8921f5924226bd0dfa54e42e65f3/users/61f2629aa8234cda8e05557ddf2e85eb/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:19.016029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:19.026697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dfb4d-22f8-487b-8208-54b8d5720975 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:19.083691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f748ad-31be-43c1-88d4-3562c41d89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:19.084313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f748ad-31be-43c1-88d4-3562c41d89ff admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:19.084596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f748ad-31be-43c1-88d4-3562c41d89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:19.084873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f748ad-31be-43c1-88d4-3562c41d89ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:19.085572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f748ad-31be-43c1-88d4-3562c41d89ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:19.087760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f748ad-31be-43c1-88d4-3562c41d89ff admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:19.098201 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1252/2510] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:19.103134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:19.113384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4a746-cb5d-4755-a475-4611abd1aeeb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:19.118444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:19.119094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:19.119407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:19.119682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] PATH_INFO: `/v3/projects/8f8d8921f5924226bd0dfa54e42e65f3/users/61f2629aa8234cda8e05557ddf2e85eb/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:19.121850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8d8921f5924226bd0dfa54e42e65f3, user_id=61f2629aa8234cda8e05557ddf2e85eb, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:19.124652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:19.135857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1259/2511] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:19 2022] PUT /identity/v3/projects/8f8d8921f5924226bd0dfa54e42e65f3/users/61f2629aa8234cda8e05557ddf2e85eb/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:19.147154 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070e70a-3b99-4d80-99e6-4ea4e672762a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:19.147522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070e70a-3b99-4d80-99e6-4ea4e672762a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:19.147805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070e70a-3b99-4d80-99e6-4ea4e672762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:19.175760 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c070e70a-3b99-4d80-99e6-4ea4e672762a None None] MFA Rules not processed for user `61f2629aa8234cda8e05557ddf2e85eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:19.176977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c070e70a-3b99-4d80-99e6-4ea4e672762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:19.197768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:19.251289 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1253/2512] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:19.262923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:19.264701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:19.326801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1163-d0ff-418c-9aef-facaa323d182 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:19.330502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:19.331123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:19.331445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:19.331736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:19.345223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:19.395121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:19.396608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:19.405790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1260/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:21.460896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:21.461467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:21.461743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:21.625069 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:21.626445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:21.689728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1254/2514] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 04:24:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:21.716383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:21.718345 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:21.876058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86098958-c5e9-42f0-85b7-cdf5a1cf05be service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:21.890229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:21.891867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:21.892310 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:21.892758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:21.903964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:21.905658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:21.919926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1261/2515] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:24:23.049705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:23.051999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:23.162028 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee77080-841f-4c30-aa37-b7cf092f4e11 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:23.167545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:23.168274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:23.168552 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:23.169000 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] PATH_INFO: `/v3/users/4c9ce0f831564bc689839bc908be22f1` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:23.170203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9ce0f831564bc689839bc908be22f1)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:23.172166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:23.228507 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9ce0f831564bc689839bc908be22f1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.236591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9ce0f831564bc689839bc908be22f1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.247521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9ce0f831564bc689839bc908be22f1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.248261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9ce0f831564bc689839bc908be22f1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.248982 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9ce0f831564bc689839bc908be22f1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.251398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:23.275151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1255/2516] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:23 2022] DELETE /identity/v3/users/4c9ce0f831564bc689839bc908be22f1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:23.286654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:23.289630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:23.362128 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5f31c-ac45-470b-b24e-2b0d05f75763 service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:23.415867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe2cd7-9446-4de3-b8e4-261a5bfef4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:23.416381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2cd7-9446-4de3-b8e4-261a5bfef4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:23.416667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2cd7-9446-4de3-b8e4-261a5bfef4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:23.416942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2cd7-9446-4de3-b8e4-261a5bfef4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:23.418704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e6fe2cd7-9446-4de3-b8e4-261a5bfef4b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:23.433736 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:23.486000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe2cd7-9446-4de3-b8e4-261a5bfef4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:23.487573 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe2cd7-9446-4de3-b8e4-261a5bfef4b0 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:23.498782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1262/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:23.688100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:23.689631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:23.710118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03090bb-e3ea-4ac9-ad7e-f15b1340d6a7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:23.717019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:23.717727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:23.718160 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:23.718257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] PATH_INFO: `/v3/projects/e168c5eb0c474ff6909edf8176b354bc` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:23.719437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e168c5eb0c474ff6909edf8176b354bc)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:23.721754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:23.778597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e168c5eb0c474ff6909edf8176b354bc', 'request_id': 'req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.788456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e168c5eb0c474ff6909edf8176b354bc', 'request_id': 'req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.795387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e168c5eb0c474ff6909edf8176b354bc', 'request_id': 'req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.810714 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] The token cache is being invalidate because project e168c5eb0c474ff6909edf8176b354bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:23.811144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.811926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a413277c-7b15-4ec7-8c66-dd148e4cbbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:23.814649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1256/2518] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:23 2022] DELETE /identity/v3/projects/e168c5eb0c474ff6909edf8176b354bc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:23.819612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c1905-af1f-4f36-9d30-9588b55c34e3 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:23.819905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c1905-af1f-4f36-9d30-9588b55c34e3 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:23.820242 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c1905-af1f-4f36-9d30-9588b55c34e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:23.842907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-508c1905-af1f-4f36-9d30-9588b55c34e3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:23.844230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-508c1905-af1f-4f36-9d30-9588b55c34e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:23.908715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1263/2519] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:23.917661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66533-8c38-4929-90f1-6e229ce3e4e9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:23.917995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66533-8c38-4929-90f1-6e229ce3e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:23.918219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66533-8c38-4929-90f1-6e229ce3e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:23.939747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ebc66533-8c38-4929-90f1-6e229ce3e4e9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:23.941107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ebc66533-8c38-4929-90f1-6e229ce3e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:23.950236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1257/2520] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:23.954838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c1905-af1f-4f36-9d30-9588b55c34e3 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:23.967604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c1905-af1f-4f36-9d30-9588b55c34e3 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:23.973971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:23.974696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:23.975047 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:23.975432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:23.976430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:23.977438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:23.979503 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.000014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1264/2521] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:24:24.001566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66533-8c38-4929-90f1-6e229ce3e4e9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:24.016720 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66533-8c38-4929-90f1-6e229ce3e4e9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:24.021608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:24.022383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.022735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.023077 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.024386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:24.026756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.063632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1258/2522] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:24 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:24.067581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:24.078459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2d15-2f2e-4cce-9c68-e49d18577cd7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:24.146791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:24.147527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.148001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.149095 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.150347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:24.152443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.186080 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1265/2523] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:24 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:24.190227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:24.201608 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2723ea-b606-44c8-82ad-9a1c0865c889 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:24.207626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:24.208435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.209088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.209529 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.210238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:24.212479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.227715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1259/2524] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:24.230135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:24.241400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6353e-dff6-4e6d-9370-c7ec1193711a admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:24.246927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:24.247590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.248223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.248521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.249227 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:24.250859 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.263414 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1266/2525] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:24.267771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:24.284229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ff06-8d69-445a-806e-d9b61496b539 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:24.290703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81c258-a5ef-4996-a250-fbc24aa0eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:24.291771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c258-a5ef-4996-a250-fbc24aa0eeb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.292177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c258-a5ef-4996-a250-fbc24aa0eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.292554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c258-a5ef-4996-a250-fbc24aa0eeb8 admin admin] PATH_INFO: `/v3/projects/0bd84e5ae6dc4dba981c4b546b005231/users/d89399f1af974af28ef44cc4b266e936/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.296000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:24.297873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:24.308721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81c258-a5ef-4996-a250-fbc24aa0eeb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd84e5ae6dc4dba981c4b546b005231, user_id=d89399f1af974af28ef44cc4b266e936, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:24.311534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81c258-a5ef-4996-a250-fbc24aa0eeb8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.321593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:24.330102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1260/2526] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:24 2022] PUT /identity/v3/projects/0bd84e5ae6dc4dba981c4b546b005231/users/d89399f1af974af28ef44cc4b266e936/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:24.341396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.341917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.342195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.371379 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4a667-eb89-4a08-bb84-68c0f5b925be admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:24.376872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] MFA Rules not processed for user `d89399f1af974af28ef44cc4b266e936`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:24.378126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:24.439977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:24.448342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:24.449695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.449695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.450044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.452896 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:24.461736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1261/2527] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:24.474586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:24.476339 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:24.489361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89213e04-3369-4f27-9949-ea11d5ecf5b9 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:24.493727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:24.494492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:24.494751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:24.495087 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:24.509864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:24.511717 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.521435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1262/2528] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:24:24.532957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:24.534432 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:24.544761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1267/2529] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:28.692237 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:28.693838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:28.757141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fcc76-eeac-469f-b31d-9f1061c6aad8 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:28.761851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d827c7-a4d1-408a-ac56-906dd9865309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:28.762482 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d827c7-a4d1-408a-ac56-906dd9865309 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:28.762762 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d827c7-a4d1-408a-ac56-906dd9865309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:28.763576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d827c7-a4d1-408a-ac56-906dd9865309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:28.766229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-72d827c7-a4d1-408a-ac56-906dd9865309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:28.842788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d827c7-a4d1-408a-ac56-906dd9865309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:28.844429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d827c7-a4d1-408a-ac56-906dd9865309 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:28.855975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1263/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:28.959886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:28.961394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:28.978926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060ba5-ef80-4709-af72-7696b36fc090 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:28.984681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:28.985721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:28.986140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:28.986734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] PATH_INFO: `/v3/users/851b4defd9584a7c97ddf9a9b4560e54` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:28.988076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851b4defd9584a7c97ddf9a9b4560e54)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:28.990199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:29.047016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851b4defd9584a7c97ddf9a9b4560e54'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.047847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851b4defd9584a7c97ddf9a9b4560e54'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.048472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851b4defd9584a7c97ddf9a9b4560e54'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.077440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851b4defd9584a7c97ddf9a9b4560e54'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.085120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851b4defd9584a7c97ddf9a9b4560e54'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.090346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:29.108050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1268/2531] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:28 2022] DELETE /identity/v3/users/851b4defd9584a7c97ddf9a9b4560e54 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:29.113934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:29.114305 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:29.114664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:29.135985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:29.137195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:29.211850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1264/2532] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:29.222005 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:29.223561 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:29.298045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5f74d-c42f-4e3c-adae-dc1eed369dc8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:29.302501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:29.303338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:29.303621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:29.303895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:29.316153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:29.317588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:29.330313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1269/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:29.663475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:29.665820 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:29.681856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d617f5-8c75-4eef-9e6a-f8c7c73ab6dd None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:29.686487 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:29.687133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:29.687526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:29.687803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] PATH_INFO: `/v3/projects/ca74e880a25d41c3baae5bb6fae05d05` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:29.689193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca74e880a25d41c3baae5bb6fae05d05)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:29.691043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:29.719042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:29.760218 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca74e880a25d41c3baae5bb6fae05d05', 'request_id': 'req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.769346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca74e880a25d41c3baae5bb6fae05d05', 'request_id': 'req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.776989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca74e880a25d41c3baae5bb6fae05d05', 'request_id': 'req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.789684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] The token cache is being invalidate because project ca74e880a25d41c3baae5bb6fae05d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:29.789971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.791823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.793593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1265/2534] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:29 2022] DELETE /identity/v3/projects/ca74e880a25d41c3baae5bb6fae05d05 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:29.797658 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:29.808357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393a60-9551-41e0-a27f-dab3a9bb80c8 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:29.881832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:29.883152 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:29.883710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:29.883853 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] PATH_INFO: `/v3/users/61f2629aa8234cda8e05557ddf2e85eb` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:29.885071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f2629aa8234cda8e05557ddf2e85eb)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:29.887058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:29.949335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f2629aa8234cda8e05557ddf2e85eb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.950073 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f2629aa8234cda8e05557ddf2e85eb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.955399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f2629aa8234cda8e05557ddf2e85eb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.969979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f2629aa8234cda8e05557ddf2e85eb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.979533 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-59a7e83f-188b-41be-8f47-72b196a557d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f2629aa8234cda8e05557ddf2e85eb'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:29.998287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1270/2535] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:29 2022] DELETE /identity/v3/users/61f2629aa8234cda8e05557ddf2e85eb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:30.307949 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:30.309432 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:30.327593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4aca5-6c3a-48f8-ab7f-212d664fe58b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:30.388488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:30.389126 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.389406 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.389681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] PATH_INFO: `/v3/projects/8f8d8921f5924226bd0dfa54e42e65f3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.390822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8d8921f5924226bd0dfa54e42e65f3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:30.392795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:30.439704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8d8921f5924226bd0dfa54e42e65f3', 'request_id': 'req-b4c470f1-6aea-4de3-bb6c-886393c6d301'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:30.448326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8d8921f5924226bd0dfa54e42e65f3', 'request_id': 'req-b4c470f1-6aea-4de3-bb6c-886393c6d301'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:30.455666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8d8921f5924226bd0dfa54e42e65f3', 'request_id': 'req-b4c470f1-6aea-4de3-bb6c-886393c6d301'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:30.474707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] The token cache is being invalidate because project 8f8d8921f5924226bd0dfa54e42e65f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:30.475039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:30.475665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-b4c470f1-6aea-4de3-bb6c-886393c6d301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:30.477383 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1266/2536] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:30 2022] DELETE /identity/v3/projects/8f8d8921f5924226bd0dfa54e42e65f3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:30.483228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35546-9867-4364-82b8-9e47e154c23c None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.483636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35546-9867-4364-82b8-9e47e154c23c None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.483911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35546-9867-4364-82b8-9e47e154c23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.503514 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2df35546-9867-4364-82b8-9e47e154c23c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:30.505003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2df35546-9867-4364-82b8-9e47e154c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:30.526382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:30.584315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1271/2537] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:30.592826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a3e83-99a3-42da-ad9e-e026529663fa None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.593167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a3e83-99a3-42da-ad9e-e026529663fa None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.593423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a3e83-99a3-42da-ad9e-e026529663fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.620018 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-001a3e83-99a3-42da-ad9e-e026529663fa None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:30.622604 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-001a3e83-99a3-42da-ad9e-e026529663fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:30.633796 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1267/2538] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:30.637496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df35546-9867-4364-82b8-9e47e154c23c None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:30.649841 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df35546-9867-4364-82b8-9e47e154c23c None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:30.657173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:30.657930 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.658316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.658854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.659717 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:30.660156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:30.661911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:30.678420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1272/2539] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:24:30.684112 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a3e83-99a3-42da-ad9e-e026529663fa None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:30.697892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a3e83-99a3-42da-ad9e-e026529663fa None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:30.705779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:30.706844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.707511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.707801 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.708581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:30.710704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:30.754880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1268/2540] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:30 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:30.756274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:30.768429 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c25e1-6e3d-435a-bf10-29d2721412bf admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:30.832957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:30.834086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.834086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.834318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.835023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:30.837701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:30.862318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1273/2541] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:30 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:30.867401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:30.879387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841683-27c8-40d4-a57d-f77150a34539 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:30.897181 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:30.898493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.898861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.899361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.900702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:30.902170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:30.927443 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:30.938367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1269/2542] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:24:30.941975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72d3d-9732-4118-948d-f6eb4c0cafd7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:30.948733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba82e8e-577b-4f67-a902-46e9aa5fa44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:30.949867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba82e8e-577b-4f67-a902-46e9aa5fa44f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:30.951155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba82e8e-577b-4f67-a902-46e9aa5fa44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:30.951616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba82e8e-577b-4f67-a902-46e9aa5fa44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:30.952807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba82e8e-577b-4f67-a902-46e9aa5fa44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:30.954822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba82e8e-577b-4f67-a902-46e9aa5fa44f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:30.982871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:30.988366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:30.988968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1274/2543] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:30.998295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a924f-fdd0-4312-adf4-1df837bba5ca admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:31.006517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:31.010038 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:31.010874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:31.010874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] PATH_INFO: `/v3/projects/b87e38dd2f47481281d8f9e2841e5282/users/5b786b11495747849ff3d91e222a8d3d/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:31.030257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87e38dd2f47481281d8f9e2841e5282, user_id=5b786b11495747849ff3d91e222a8d3d, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:31.033060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:31.049896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1270/2544] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:30 2022] PUT /identity/v3/projects/b87e38dd2f47481281d8f9e2841e5282/users/5b786b11495747849ff3d91e222a8d3d/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:31.066262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:31.066998 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:31.067528 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:31.105223 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] MFA Rules not processed for user `5b786b11495747849ff3d91e222a8d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:31.106811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:31.192531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1275/2545] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:31.205989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:31.208500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:31.270553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41073c-ea7e-42c1-ae08-915d33141f74 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:31.274836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:31.275473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:31.275751 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:31.276023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:31.284596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:31.286023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:31.294979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1271/2546] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:32.577733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:32.579203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:32.593973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:32.652697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deb559-d633-4bfd-8289-ee518affe745 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:32.657949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:32.658308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:32.658594 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:32.658867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] PATH_INFO: `/v3/users/ce7376d180c047e2b4c8a79e260367e0` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:32.660181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7376d180c047e2b4c8a79e260367e0)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:32.662143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:32.723155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7376d180c047e2b4c8a79e260367e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:32.724004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7376d180c047e2b4c8a79e260367e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:32.724621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7376d180c047e2b4c8a79e260367e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:32.738721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7376d180c047e2b4c8a79e260367e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:32.748618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-cca0d185-b21c-4613-9ebc-23e38aa4639a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7376d180c047e2b4c8a79e260367e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:32.762726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1276/2547] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:32 2022] DELETE /identity/v3/users/ce7376d180c047e2b4c8a79e260367e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:32.943652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:32.962277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddece5-f0ef-494c-8b42-6fbf5651b835 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.043653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.044596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.044721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.045039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] PATH_INFO: `/v3/projects/dc1d3b91997546599b14e2d921256c82` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.046260 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1d3b91997546599b14e2d921256c82)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.048370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.105616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1d3b91997546599b14e2d921256c82', 'request_id': 'req-629f4d76-b585-4204-8ea6-f918f3d5a65f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.113309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1d3b91997546599b14e2d921256c82', 'request_id': 'req-629f4d76-b585-4204-8ea6-f918f3d5a65f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.119685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1d3b91997546599b14e2d921256c82', 'request_id': 'req-629f4d76-b585-4204-8ea6-f918f3d5a65f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.131884 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] The token cache is being invalidate because project dc1d3b91997546599b14e2d921256c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:33.132807 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.133457 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-629f4d76-b585-4204-8ea6-f918f3d5a65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.134958 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1272/2548] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:32 2022] DELETE /identity/v3/projects/dc1d3b91997546599b14e2d921256c82 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:33.139933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.140218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.140491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.166807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:33.168072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.237764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1277/2549] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:33.240097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1190-5d37-4de6-b77b-b30fe6377341 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.240433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1190-5d37-4de6-b77b-b30fe6377341 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.240783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf1190-5d37-4de6-b77b-b30fe6377341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.262568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2daf1190-5d37-4de6-b77b-b30fe6377341 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:33.263872 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2daf1190-5d37-4de6-b77b-b30fe6377341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.266513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.267967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.273648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1273/2550] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:33.277800 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1190-5d37-4de6-b77b-b30fe6377341 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.284026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:33.289021 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf1190-5d37-4de6-b77b-b30fe6377341 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.289208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e02db-a94c-4ff8-ace9-eec375eca522 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.294706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.295566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.296194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.296704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.297038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] PATH_INFO: `/v3/users/d89399f1af974af28ef44cc4b266e936` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.297324 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.297625 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.297904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.298772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:33.299208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89399f1af974af28ef44cc4b266e936)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.299766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.301518 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.303409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.315414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1274/2551] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:24:33.319409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.333713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38c1c0-0c03-4d8c-991a-e19918a9fedc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.338147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:33.339391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.340207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.340558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.340815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.341662 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.343901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.376706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89399f1af974af28ef44cc4b266e936'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.377750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89399f1af974af28ef44cc4b266e936'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.378535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89399f1af974af28ef44cc4b266e936'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.383298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1275/2552] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:33 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:33.385203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.386959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.396564 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89399f1af974af28ef44cc4b266e936'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.413249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-bbdee880-85a6-4f6f-957c-39c68e9792a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89399f1af974af28ef44cc4b266e936'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:33.425417 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1278/2553] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:33 2022] DELETE /identity/v3/users/d89399f1af974af28ef44cc4b266e936 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:33.430475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.430928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.431290 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.450512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:33.451952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.466274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293091-d956-45b5-955f-82f136ce6d8c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.533212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.533915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.534272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.534745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.535538 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.537817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.541804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1279/2554] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:33.556994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.558846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.581027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1276/2555] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:33 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:33.586700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.606090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ace0d-0f85-4567-aa50-28095f93699f admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.614150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.614918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.615384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.615730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.617074 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.619101 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.630427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe095-951d-4c4a-ab89-8202a410cce9 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.635550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1277/2556] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:33.636563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.637942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.638798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.639607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.640214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.649942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0268-3587-44de-93bb-f745a1fac88e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.653964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.655556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6417c2a-b090-45a0-b65c-77ef3e8daf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.656280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6417c2a-b090-45a0-b65c-77ef3e8daf40 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.656664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6417c2a-b090-45a0-b65c-77ef3e8daf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.656970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.657226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6417c2a-b090-45a0-b65c-77ef3e8daf40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.658015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6417c2a-b090-45a0-b65c-77ef3e8daf40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.660060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6417c2a-b090-45a0-b65c-77ef3e8daf40 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.671473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1280/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:24:33.681693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1278/2558] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:33.685975 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.699496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e34bc-1e36-4f74-b5e6-dbc72161a575 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.701903 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.702437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.702728 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.703011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] PATH_INFO: `/v3/projects/89e3a0040904473bae0a171d3ed74015/users/db57582b94144b229b32a473be88593f/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.718894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e3a0040904473bae0a171d3ed74015, user_id=db57582b94144b229b32a473be88593f, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.722002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.737177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1281/2559] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:33 2022] PUT /identity/v3/projects/89e3a0040904473bae0a171d3ed74015/users/db57582b94144b229b32a473be88593f/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:33.747977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.748281 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.748565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.784946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] MFA Rules not processed for user `db57582b94144b229b32a473be88593f`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:33.786279 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.825198 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:33.860089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1279/2560] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:33.872669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.874075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.902233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:33.951484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4c87a-8dff-4583-a294-4a210cff075e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:33.959965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a90af5-53e1-4c59-a08f-9d88b04bfac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:33.960516 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:33.961272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90af5-53e1-4c59-a08f-9d88b04bfac6 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:33.961650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90af5-53e1-4c59-a08f-9d88b04bfac6 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:33.961932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a90af5-53e1-4c59-a08f-9d88b04bfac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:33.962344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:33.977307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a90af5-53e1-4c59-a08f-9d88b04bfac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:33.979138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a90af5-53e1-4c59-a08f-9d88b04bfac6 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:33.988709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1282/2561] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:34.043033 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ab009-98f6-47e4-8f43-a26f961a857d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.047913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.048566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.048851 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.049220 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] PATH_INFO: `/v3/projects/0bd84e5ae6dc4dba981c4b546b005231` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.050450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd84e5ae6dc4dba981c4b546b005231)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.052396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.099615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd84e5ae6dc4dba981c4b546b005231', 'request_id': 'req-25505946-02bf-4ee4-86ec-d4edfd544005'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.108263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd84e5ae6dc4dba981c4b546b005231', 'request_id': 'req-25505946-02bf-4ee4-86ec-d4edfd544005'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.115226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd84e5ae6dc4dba981c4b546b005231', 'request_id': 'req-25505946-02bf-4ee4-86ec-d4edfd544005'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.128263 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] The token cache is being invalidate because project 0bd84e5ae6dc4dba981c4b546b005231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:34.128558 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.129488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-25505946-02bf-4ee4-86ec-d4edfd544005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.131163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1280/2562] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:33 2022] DELETE /identity/v3/projects/0bd84e5ae6dc4dba981c4b546b005231 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:34.136957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7db3-0518-4ade-bb2c-5db848616461 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.137339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7db3-0518-4ade-bb2c-5db848616461 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.137691 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7db3-0518-4ade-bb2c-5db848616461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.159589 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-47df7db3-0518-4ade-bb2c-5db848616461 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:34.160961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-47df7db3-0518-4ade-bb2c-5db848616461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:34.228151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1283/2563] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:34.236287 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8767-470c-4d4a-95c3-709476095b0b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.236646 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8767-470c-4d4a-95c3-709476095b0b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.237001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8767-470c-4d4a-95c3-709476095b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.257605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-aa3a8767-470c-4d4a-95c3-709476095b0b None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:34.259167 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-aa3a8767-470c-4d4a-95c3-709476095b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:34.273498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1281/2564] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:34.274788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7db3-0518-4ade-bb2c-5db848616461 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.285151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7db3-0518-4ade-bb2c-5db848616461 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.291041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.292147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.292397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.292768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.293898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:34.294301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.296065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.314899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1284/2565] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:24:34.316256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8767-470c-4d4a-95c3-709476095b0b None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.326795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8767-470c-4d4a-95c3-709476095b0b None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.336142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.336846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.337202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.337486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.338179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.340166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.381043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1282/2566] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:34.382449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.392395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6293d-2e4e-44fd-b61d-e00551c28495 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.441429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.443627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:34.454306 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.454929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.455213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.455520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.456185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.458149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.479874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1285/2567] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:34.483933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.489566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:34.494753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc1823-3094-455a-a1ee-54ca7d38cb8f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.500684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.501331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.501655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.501888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.502586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.504238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.515556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1286/2568] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:24:34.520407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.524229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7696a-4f2c-4cd9-883d-b7b1736f9bd7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.528877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.529515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.529794 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.530066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] PATH_INFO: `/v3/users/5b786b11495747849ff3d91e222a8d3d` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.530609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7379324-b33d-4e96-ad5e-7a6bd048d120 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.531231 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b786b11495747849ff3d91e222a8d3d)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.533172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.535398 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.536066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.536350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.536751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.537427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.539440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.551329 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1287/2569] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:34.556644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.563433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:34.568472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a644-6c9d-4d18-a17e-553b770c6e65 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.574820 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3cb2f-0037-4752-ad6a-63ea9ed5bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.575506 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3cb2f-0037-4752-ad6a-63ea9ed5bd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.575789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3cb2f-0037-4752-ad6a-63ea9ed5bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.576066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3cb2f-0037-4752-ad6a-63ea9ed5bd6d admin admin] PATH_INFO: `/v3/projects/8fd5cc56bac54550bf29091ac5394248/users/97dbfa8a776e4d029ae71bb76cc20ae9/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.585792 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b786b11495747849ff3d91e222a8d3d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.592226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3cb2f-0037-4752-ad6a-63ea9ed5bd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd5cc56bac54550bf29091ac5394248, user_id=97dbfa8a776e4d029ae71bb76cc20ae9, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.593107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b786b11495747849ff3d91e222a8d3d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.595052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3cb2f-0037-4752-ad6a-63ea9ed5bd6d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.601850 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b786b11495747849ff3d91e222a8d3d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.602684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b786b11495747849ff3d91e222a8d3d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.603544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f21c3b19-a98c-4a9e-a5e7-e9838d2eda4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b786b11495747849ff3d91e222a8d3d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:34.609416 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1288/2570] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:34 2022] PUT /identity/v3/projects/8fd5cc56bac54550bf29091ac5394248/users/97dbfa8a776e4d029ae71bb76cc20ae9/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:34.622439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.622861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.623222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.624010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1283/2571] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:34 2022] DELETE /identity/v3/users/5b786b11495747849ff3d91e222a8d3d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:34.628078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.628372 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.628648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.653881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:34.655609 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:34.666776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] MFA Rules not processed for user `97dbfa8a776e4d029ae71bb76cc20ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:34.668255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:34.730959 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1284/2572] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:34.746718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.747925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1289/2573] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:34.748143 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:34.751926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.753238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:34.769343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9e211-2721-4a10-8625-fe154cf0ce57 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.775127 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.778215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.778215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.778215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.778215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.778918 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.809267 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1290/2574] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:34.812912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.816665 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dc4d9-9725-4dca-9cbe-d55c54c473a3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.826090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:34.878834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.879494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.879793 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.880048 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.881950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a059e-6e63-4842-92c4-bcb36aabd60e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.887570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.888218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.888509 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.888790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.889469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.891453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.897371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.899661 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.909945 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1285/2575] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:24:34.921428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1291/2576] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:34 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:34.925517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.935350 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3f582-ddf8-4b73-b9ae-fb68716abb0a service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.940131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.940740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.941023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.941297 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.941994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:34.943764 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:34.955178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1286/2577] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:34.959617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:34.971747 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1537a-3826-4d88-aa9d-5c8c4c00ceb2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:34.977846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:34.978946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:34.979321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:34.979807 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] PATH_INFO: `/v3/projects/78f4814842aa4b66b9b34aef7477c931/users/232ebc8dab5f4e1f91c62d242ae3733b/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:34.998499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f4814842aa4b66b9b34aef7477c931, user_id=232ebc8dab5f4e1f91c62d242ae3733b, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.001205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.015833 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1292/2578] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:34 2022] PUT /identity/v3/projects/78f4814842aa4b66b9b34aef7477c931/users/232ebc8dab5f4e1f91c62d242ae3733b/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:35.019864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.030768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2838d1-a150-40d8-aafb-1f0e83d99acd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.098200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bf96a-f7a4-4a17-91ff-fe6c73861c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.098848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf96a-f7a4-4a17-91ff-fe6c73861c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.099131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf96a-f7a4-4a17-91ff-fe6c73861c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.099447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf96a-f7a4-4a17-91ff-fe6c73861c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.100166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bf96a-f7a4-4a17-91ff-fe6c73861c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.102426 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bf96a-f7a4-4a17-91ff-fe6c73861c03 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.114016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1287/2579] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:35.119072 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.130156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270610e-0a2f-403d-bc60-91c1ea71280b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.135973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.136670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.136952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.137225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] PATH_INFO: `/v3/projects/78f4814842aa4b66b9b34aef7477c931/users/232ebc8dab5f4e1f91c62d242ae3733b/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.139858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f4814842aa4b66b9b34aef7477c931, user_id=232ebc8dab5f4e1f91c62d242ae3733b, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.142598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.152134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:35.157438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1293/2580] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:35 2022] PUT /identity/v3/projects/78f4814842aa4b66b9b34aef7477c931/users/232ebc8dab5f4e1f91c62d242ae3733b/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:35.172213 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.172921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.173212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.207278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] MFA Rules not processed for user `232ebc8dab5f4e1f91c62d242ae3733b`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:35.208613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.222044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.223909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.299243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1288/2581] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:35.299470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53886df9-4d85-4f8f-aaa1-6cd07a87422c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.304445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.305094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.305496 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.306133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] PATH_INFO: `/v3/projects/b87e38dd2f47481281d8f9e2841e5282` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.307913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87e38dd2f47481281d8f9e2841e5282)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.310066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.311381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.312816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.342575 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:35.362937 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87e38dd2f47481281d8f9e2841e5282', 'request_id': 'req-b34b2eb5-3852-4871-a66f-e1758eaa82e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:35.369052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87e38dd2f47481281d8f9e2841e5282', 'request_id': 'req-b34b2eb5-3852-4871-a66f-e1758eaa82e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:35.373778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fa8c3-14d5-4c3c-bc0d-52f8b9289905 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.377012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87e38dd2f47481281d8f9e2841e5282', 'request_id': 'req-b34b2eb5-3852-4871-a66f-e1758eaa82e0'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:35.390377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] The token cache is being invalidate because project b87e38dd2f47481281d8f9e2841e5282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:35.390670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:35.391364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b34b2eb5-3852-4871-a66f-e1758eaa82e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:35.397307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1294/2582] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:35 2022] DELETE /identity/v3/projects/b87e38dd2f47481281d8f9e2841e5282 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:35.399585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c148bff-ae27-42fa-b879-b53dc9745263 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.399870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c148bff-ae27-42fa-b879-b53dc9745263 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.400145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c148bff-ae27-42fa-b879-b53dc9745263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.423012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0c148bff-ae27-42fa-b879-b53dc9745263 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:35.424124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0c148bff-ae27-42fa-b879-b53dc9745263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.428854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.429819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.430204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.430783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.433530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.489952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1295/2583] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:35.500380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a742fc-82a5-4d8f-9de8-76f59e86d0ad None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.501064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a742fc-82a5-4d8f-9de8-76f59e86d0ad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.501344 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a742fc-82a5-4d8f-9de8-76f59e86d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.523482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c8a742fc-82a5-4d8f-9de8-76f59e86d0ad None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:35.524743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.524928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c8a742fc-82a5-4d8f-9de8-76f59e86d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.526192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.536499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1296/2584] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:35.537766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1289/2585] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:24:35.541296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a742fc-82a5-4d8f-9de8-76f59e86d0ad None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.550571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a742fc-82a5-4d8f-9de8-76f59e86d0ad None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.555703 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.556185 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.556464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.556740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.557441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:35.558067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.559772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.579481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1297/2586] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:35.583808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.603320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908275b-e9b1-4e50-9e31-c68c923f3a1a service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.608668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.609455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.609890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.610292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.611093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.613290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.637373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.639428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.649589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1290/2587] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:35 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:35.652966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b928-70bc-4921-8765-b536afd82f77 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.653874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.662613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:35.711789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.712542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.712701 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.713092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.714965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:35.732995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5151ed-20af-43f7-aac0-761895a72c97 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.737939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.738615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.738897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.739172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.739957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.742488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.764576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:35.773880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1291/2588] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:35 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:35.778269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.790705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86718-f795-4e50-ba07-1fff2969b059 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.791850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.793311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.795385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.795999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.796284 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.796561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.797255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.798878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.802228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1298/2589] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:35.811290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1292/2590] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:35.813591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.824673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd1f9-8732-4c19-b7f2-333e3e87a502 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.829404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d036-1ba8-4c7d-86de-c1f2b1917f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.830014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d036-1ba8-4c7d-86de-c1f2b1917f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.830318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d036-1ba8-4c7d-86de-c1f2b1917f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.830582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d036-1ba8-4c7d-86de-c1f2b1917f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.831293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d036-1ba8-4c7d-86de-c1f2b1917f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.833025 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d036-1ba8-4c7d-86de-c1f2b1917f8a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.844318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1299/2591] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:35.848952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:35.861257 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be84c-118e-40b6-b21a-ba7250962afc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:35.867013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:35.867711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.867991 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.868272 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] PATH_INFO: `/v3/projects/41a0bfa0c36a4e04835b33a5794a1314/users/93d7d3b63577463b8285a81d7afd37d1/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.885293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a0bfa0c36a4e04835b33a5794a1314, user_id=93d7d3b63577463b8285a81d7afd37d1, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:35.888495 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:35.901144 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1293/2592] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:35 2022] PUT /identity/v3/projects/41a0bfa0c36a4e04835b33a5794a1314/users/93d7d3b63577463b8285a81d7afd37d1/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:35.916781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375326-2e00-49af-bc34-117640f222ca None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:35.917051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375326-2e00-49af-bc34-117640f222ca None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:35.917352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375326-2e00-49af-bc34-117640f222ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:35.968280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d2375326-2e00-49af-bc34-117640f222ca None None] MFA Rules not processed for user `93d7d3b63577463b8285a81d7afd37d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:35.969550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d2375326-2e00-49af-bc34-117640f222ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:36.037220 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1300/2593] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:36.048795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:36.105989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262606f-1542-417b-ad2a-f589cee00c77 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:36.109590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e049-d8d0-4c3a-a75a-2774cd124cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:36.110205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e049-d8d0-4c3a-a75a-2774cd124cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:36.110485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e049-d8d0-4c3a-a75a-2774cd124cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:36.110761 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e049-d8d0-4c3a-a75a-2774cd124cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:36.119012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51e049-d8d0-4c3a-a75a-2774cd124cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:36.120464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51e049-d8d0-4c3a-a75a-2774cd124cb5 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:36.129150 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1294/2594] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:36.721729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2375326-2e00-49af-bc34-117640f222ca None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:36.721729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d2375326-2e00-49af-bc34-117640f222ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:36.767905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:36.786016 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2375326-2e00-49af-bc34-117640f222ca None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:36.790502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:36.791135 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:36.791446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:36.791722 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] PATH_INFO: `/v3/users/db57582b94144b229b32a473be88593f` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:36.792887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db57582b94144b229b32a473be88593f)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:36.794821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:36.840082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db57582b94144b229b32a473be88593f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:36.840724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db57582b94144b229b32a473be88593f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:36.841316 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db57582b94144b229b32a473be88593f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:36.853026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db57582b94144b229b32a473be88593f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:36.860114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db57582b94144b229b32a473be88593f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:36.872780 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1301/2595] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:36 2022] DELETE /identity/v3/users/db57582b94144b229b32a473be88593f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:36.877446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:36.877758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:36.878032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:36.899700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:36.900890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:36.959064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1295/2596] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:36.968799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:36.970208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:37.030493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053d27-a582-4631-bffc-b52a41ea69f9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.034255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89652-73f9-4802-ad17-ec036588dd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.034867 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89652-73f9-4802-ad17-ec036588dd4e service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.035143 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89652-73f9-4802-ad17-ec036588dd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.035446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89652-73f9-4802-ad17-ec036588dd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.045790 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf89652-73f9-4802-ad17-ec036588dd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.047214 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf89652-73f9-4802-ad17-ec036588dd4e service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.058408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1302/2597] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:37.368542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:37.372223 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:37.391946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367c19-56e9-4d6e-9be4-6a1fd0bbd535 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.398561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.402136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.402487 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.402834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] PATH_INFO: `/v3/projects/89e3a0040904473bae0a171d3ed74015` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.404456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e3a0040904473bae0a171d3ed74015)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.407577 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.466501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e3a0040904473bae0a171d3ed74015', 'request_id': 'req-2f67cec0-b068-47e5-ac31-13822ba5136f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:37.473897 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e3a0040904473bae0a171d3ed74015', 'request_id': 'req-2f67cec0-b068-47e5-ac31-13822ba5136f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:37.478556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:37.480950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e3a0040904473bae0a171d3ed74015', 'request_id': 'req-2f67cec0-b068-47e5-ac31-13822ba5136f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:37.493548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] The token cache is being invalidate because project 89e3a0040904473bae0a171d3ed74015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:37.493730 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:37.494381 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-2f67cec0-b068-47e5-ac31-13822ba5136f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:37.495917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1296/2598] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:37 2022] DELETE /identity/v3/projects/89e3a0040904473bae0a171d3ed74015 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:37.500752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005559-58e1-4946-959b-b3a134eb6c67 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.501041 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005559-58e1-4946-959b-b3a134eb6c67 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.501353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005559-58e1-4946-959b-b3a134eb6c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.520899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8b005559-58e1-4946-959b-b3a134eb6c67 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:37.522090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8b005559-58e1-4946-959b-b3a134eb6c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:37.587885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1303/2599] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:37.596189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc85a-5d91-41c4-8a20-2e2f1a748615 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.596480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc85a-5d91-41c4-8a20-2e2f1a748615 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.596756 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc85a-5d91-41c4-8a20-2e2f1a748615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.618915 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b12fc85a-5d91-41c4-8a20-2e2f1a748615 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:37.620157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b12fc85a-5d91-41c4-8a20-2e2f1a748615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:37.628895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1297/2600] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:37.634265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b005559-58e1-4946-959b-b3a134eb6c67 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:37.644331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b005559-58e1-4946-959b-b3a134eb6c67 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.650873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.651547 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.651849 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.652114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.652815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:37.653148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.654753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.656384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:37.675177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc85a-5d91-41c4-8a20-2e2f1a748615 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:37.679619 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1304/2601] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:37.685414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc85a-5d91-41c4-8a20-2e2f1a748615 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.689727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.690336 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.690618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.690889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.691584 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.693491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.730153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1298/2602] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:37 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:37.734638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:37.745406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146dcd-9804-407c-abd4-376cf0707fd6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.810218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.810865 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.811175 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.811671 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.812184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.814161 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.839785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1305/2603] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:37 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:37.843722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:37.854589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169933-d2cc-4231-9d46-201bd1db291c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.859545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.860153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.860435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.860711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.861531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.863183 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.874565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1299/2604] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:37.878647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:37.890811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf5069-241b-45c2-bbbd-a0299c97670c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.895955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6a59c-f4ae-4d6b-9649-2e8e166f80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.896655 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a59c-f4ae-4d6b-9649-2e8e166f80bd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.897002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a59c-f4ae-4d6b-9649-2e8e166f80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.897364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a59c-f4ae-4d6b-9649-2e8e166f80bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.898690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6a59c-f4ae-4d6b-9649-2e8e166f80bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.900406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6a59c-f4ae-4d6b-9649-2e8e166f80bd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.911541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1306/2605] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:37.915858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:37.927707 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d850-0ead-48d0-a9b7-903ef144a891 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:37.933023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:37.933689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.933976 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.934256 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] PATH_INFO: `/v3/projects/ed59d20d85c34229bf09bfb14de381dd/users/c12f7568d0924bbe9b4b539d7e7185f4/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:37.950093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed59d20d85c34229bf09bfb14de381dd, user_id=c12f7568d0924bbe9b4b539d7e7185f4, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:37.952815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:37.965825 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1300/2606] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:37 2022] PUT /identity/v3/projects/ed59d20d85c34229bf09bfb14de381dd/users/c12f7568d0924bbe9b4b539d7e7185f4/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:37.978241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5e9ac-5ce2-40df-bfab-db64a927cdd2 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:37.978555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5e9ac-5ce2-40df-bfab-db64a927cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:37.978939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5e9ac-5ce2-40df-bfab-db64a927cdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.007527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-ebd5e9ac-5ce2-40df-bfab-db64a927cdd2 None None] MFA Rules not processed for user `c12f7568d0924bbe9b4b539d7e7185f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:38.008816 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ebd5e9ac-5ce2-40df-bfab-db64a927cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:38.074039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1307/2607] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:38.078632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:38.141983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927bcca-5332-4f01-8cee-bdc2d0795763 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:38.146563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:38.147168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.147990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.148565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.149073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:38.150979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:38.177094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1301/2608] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:38 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:38.181218 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5e9ac-5ce2-40df-bfab-db64a927cdd2 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:38.191969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5e9ac-5ce2-40df-bfab-db64a927cdd2 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:38.248362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:38.248897 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.249174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.249446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.250100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:38.252056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:38.260984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:38.274843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1308/2609] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:38 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:38.278888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:38.289100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058af9-6ff5-44a6-9876-5a863b72e4a8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:38.293826 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:38.294446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.294733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.295011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.295783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:38.297386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:38.308427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1302/2610] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:38.312348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:38.322240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62e28-613e-475f-8f04-71df389e76d6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:38.326814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:38.327502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.327805 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.328066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] PATH_INFO: `/v3/projects/f4ca1f0c9c844980b60391d43e1e153c/users/429c6f3b96674a74809af1390027392c/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.344938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ca1f0c9c844980b60391d43e1e153c, user_id=429c6f3b96674a74809af1390027392c, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:38.347966 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:38.362367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1309/2611] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:38 2022] PUT /identity/v3/projects/f4ca1f0c9c844980b60391d43e1e153c/users/429c6f3b96674a74809af1390027392c/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:38.366409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:38.376773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f67c7-c52e-495b-b5e2-b550d5d78b95 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:38.434104 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467b3b-a8c2-4497-8151-c66b76863491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:38.434740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467b3b-a8c2-4497-8151-c66b76863491 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.435019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467b3b-a8c2-4497-8151-c66b76863491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.435320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467b3b-a8c2-4497-8151-c66b76863491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.436005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467b3b-a8c2-4497-8151-c66b76863491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:38.437635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467b3b-a8c2-4497-8151-c66b76863491 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:38.439068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:38.453659 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1303/2612] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:38.458237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:38.470673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17649b44-69d7-4cae-a3e4-3b1ed70df71b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:38.476382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:38.477033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.477570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.477570 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] PATH_INFO: `/v3/projects/f4ca1f0c9c844980b60391d43e1e153c/users/429c6f3b96674a74809af1390027392c/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.480013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ca1f0c9c844980b60391d43e1e153c, user_id=429c6f3b96674a74809af1390027392c, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:38.482963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:38.500281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1310/2613] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:38 2022] PUT /identity/v3/projects/f4ca1f0c9c844980b60391d43e1e153c/users/429c6f3b96674a74809af1390027392c/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:38.511135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2def-5dc2-4eda-8d43-f7d83880306a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.511453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2def-5dc2-4eda-8d43-f7d83880306a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.511740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2def-5dc2-4eda-8d43-f7d83880306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.547639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c87b2def-5dc2-4eda-8d43-f7d83880306a None None] MFA Rules not processed for user `429c6f3b96674a74809af1390027392c`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:38.548847 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c87b2def-5dc2-4eda-8d43-f7d83880306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:38.619180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1304/2614] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:38.630750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:38.633354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:38.696258 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719f82-f3ed-4e27-b6da-90214b306225 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:38.699944 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:38.700555 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:38.700831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:38.701104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:38.760605 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:38.761980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:38.771273 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1311/2615] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:41.408379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2def-5dc2-4eda-8d43-f7d83880306a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:41.418903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2def-5dc2-4eda-8d43-f7d83880306a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:41.422428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea4f89-8345-4691-9db6-f14cf4457b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:41.423111 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4f89-8345-4691-9db6-f14cf4457b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:41.423485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4f89-8345-4691-9db6-f14cf4457b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:41.423823 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4f89-8345-4691-9db6-f14cf4457b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:41.433871 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea4f89-8345-4691-9db6-f14cf4457b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:41.435423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea4f89-8345-4691-9db6-f14cf4457b00 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:41.445368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1305/2616] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:42.058390 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:42.060136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:42.143221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4efe-d32b-472a-9c8c-5fa0d4b3e3ae service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:42.148961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:42.149601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:42.149878 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:42.150148 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] PATH_INFO: `/v3/users/97dbfa8a776e4d029ae71bb76cc20ae9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:42.151365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dbfa8a776e4d029ae71bb76cc20ae9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:42.153477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:42.165342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:42.212014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dbfa8a776e4d029ae71bb76cc20ae9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.212677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dbfa8a776e4d029ae71bb76cc20ae9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.213352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dbfa8a776e4d029ae71bb76cc20ae9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.227710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dbfa8a776e4d029ae71bb76cc20ae9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.234745 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dbfa8a776e4d029ae71bb76cc20ae9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.248791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1312/2617] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:42 2022] DELETE /identity/v3/users/97dbfa8a776e4d029ae71bb76cc20ae9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:42.253309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:42.253597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:42.253937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:42.274235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:42.275527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:42.337663 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1306/2618] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:42.347889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:42.349300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:42.412614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a46d54-81fa-4f32-9020-1a2ff1cc9efe admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:42.416309 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:42.416926 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:42.417208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:42.417485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:42.427505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:42.429318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:42.439211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1313/2619] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:42.728896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:42.730900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:42.743966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e40316-9d12-452e-90b5-73f7d6dc4881 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:42.749435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:42.750211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:42.750582 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:42.750932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] PATH_INFO: `/v3/projects/8fd5cc56bac54550bf29091ac5394248` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:42.753086 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd5cc56bac54550bf29091ac5394248)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:42.757461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:42.819347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd5cc56bac54550bf29091ac5394248', 'request_id': 'req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.830365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd5cc56bac54550bf29091ac5394248', 'request_id': 'req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.838330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:42.839590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd5cc56bac54550bf29091ac5394248', 'request_id': 'req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.859401 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] The token cache is being invalidate because project 8fd5cc56bac54550bf29091ac5394248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:42.859705 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.861066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:42.866910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1307/2620] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:42 2022] DELETE /identity/v3/projects/8fd5cc56bac54550bf29091ac5394248 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:42.868603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:42.881387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6cc51-1ba1-407d-8a1e-8001062d21ad service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:42.952748 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:42.953387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:42.953792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:42.954074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] PATH_INFO: `/v3/users/232ebc8dab5f4e1f91c62d242ae3733b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:42.955287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=232ebc8dab5f4e1f91c62d242ae3733b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:42.957277 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:43.007710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:43.021427 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232ebc8dab5f4e1f91c62d242ae3733b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.022895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232ebc8dab5f4e1f91c62d242ae3733b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.023855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232ebc8dab5f4e1f91c62d242ae3733b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.036184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232ebc8dab5f4e1f91c62d242ae3733b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.043370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-08db9f3b-aaf1-4e46-aead-ab955100a78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232ebc8dab5f4e1f91c62d242ae3733b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.055979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1314/2621] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:42 2022] DELETE /identity/v3/users/232ebc8dab5f4e1f91c62d242ae3733b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:43.432107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:43.433641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:43.446600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f9e28-913b-44fa-80a8-e7ffe34010b0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:43.503510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:43.504146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.504427 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.504698 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] PATH_INFO: `/v3/projects/78f4814842aa4b66b9b34aef7477c931` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.505824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f4814842aa4b66b9b34aef7477c931)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:43.508423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:43.553405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f4814842aa4b66b9b34aef7477c931', 'request_id': 'req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.560759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f4814842aa4b66b9b34aef7477c931', 'request_id': 'req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.566677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f4814842aa4b66b9b34aef7477c931', 'request_id': 'req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.578551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] The token cache is being invalidate because project 78f4814842aa4b66b9b34aef7477c931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:43.578841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.579533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-5ba49543-0257-4e45-8bcb-e98e80ab7c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:43.581035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1308/2622] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:43 2022] DELETE /identity/v3/projects/78f4814842aa4b66b9b34aef7477c931 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:43.586472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa81c7-d2f9-4875-9d3f-b53adaf27e16 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.586957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa81c7-d2f9-4875-9d3f-b53adaf27e16 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.587058 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa81c7-d2f9-4875-9d3f-b53adaf27e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.606956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-89aa81c7-d2f9-4875-9d3f-b53adaf27e16 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:43.608245 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-89aa81c7-d2f9-4875-9d3f-b53adaf27e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:43.667961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1315/2623] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:43.676964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cdc0e-4571-4892-972c-92d78cf731ac None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.677253 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cdc0e-4571-4892-972c-92d78cf731ac None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.677530 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cdc0e-4571-4892-972c-92d78cf731ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.697560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ae0cdc0e-4571-4892-972c-92d78cf731ac None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:43.698754 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ae0cdc0e-4571-4892-972c-92d78cf731ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:43.706592 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1309/2624] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:43.711389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa81c7-d2f9-4875-9d3f-b53adaf27e16 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:43.721331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa81c7-d2f9-4875-9d3f-b53adaf27e16 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:43.726602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:43.727256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.727543 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.727824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.728531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:43.728840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:43.730449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:43.742454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1316/2625] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:43.746744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cdc0e-4571-4892-972c-92d78cf731ac None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:43.755993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cdc0e-4571-4892-972c-92d78cf731ac None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:43.761421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:43.762024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.762306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.762613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.763306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:43.765203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:43.792090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1310/2626] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:43 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:43.796119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:43.806494 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff13c85-a85c-4851-8929-5f0b9cf3b63e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:43.862830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:43.863469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.863752 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.864024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.864686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:43.866647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:43.887090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1317/2627] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:43 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:43.891633 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:43.901921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29317f1-f6ea-4bc8-a737-5d0dfc75a3cd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:43.906445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:43.907047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.907357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.907635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.908323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:43.909910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:43.923122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1311/2628] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:43.924282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:43.934502 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f5342-5823-4e56-8d1b-17b717bdf744 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:43.939256 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b5e51-74d3-4e7b-b6bc-f689279cb1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:43.939898 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b5e51-74d3-4e7b-b6bc-f689279cb1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.940178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b5e51-74d3-4e7b-b6bc-f689279cb1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.940449 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b5e51-74d3-4e7b-b6bc-f689279cb1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.941155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b5e51-74d3-4e7b-b6bc-f689279cb1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:43.942715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b5e51-74d3-4e7b-b6bc-f689279cb1ad admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:43.957314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1318/2629] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:43.958478 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:43.969193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca76ea-a2db-4596-907f-eb8a4197499c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:43.974152 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:43.974809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:43.975088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:43.975616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] PATH_INFO: `/v3/projects/62114fbcedc44ba2a46e210576667750/users/1397974b15ed49e4b606c5f4e35f640e/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:43.992500 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62114fbcedc44ba2a46e210576667750, user_id=1397974b15ed49e4b606c5f4e35f640e, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:43.996635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.010184 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1312/2630] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:43 2022] PUT /identity/v3/projects/62114fbcedc44ba2a46e210576667750/users/1397974b15ed49e4b606c5f4e35f640e/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:44.021361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddc4ba-754d-4b19-8767-c40d8e58d54a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.021995 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddc4ba-754d-4b19-8767-c40d8e58d54a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.022812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddc4ba-754d-4b19-8767-c40d8e58d54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.053045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a7ddc4ba-754d-4b19-8767-c40d8e58d54a None None] MFA Rules not processed for user `1397974b15ed49e4b606c5f4e35f640e`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:44.054997 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a7ddc4ba-754d-4b19-8767-c40d8e58d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:44.059721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:44.130238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1319/2631] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:44.135822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.158569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:44.217338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38302552-a5e8-4d3d-80fe-4d0392aca145 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.225258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.226295 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.226631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.226950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.227711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.229966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.259301 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1313/2632] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:44 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:44.263140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddc4ba-754d-4b19-8767-c40d8e58d54a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.276487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddc4ba-754d-4b19-8767-c40d8e58d54a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.352117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.352740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.353024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.353299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.353968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.355950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.376646 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1320/2633] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:44 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:44.380763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.391547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448365a4-89de-4df7-b0fd-d4dadd0940f3 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.396446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.397081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.397408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.397743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.398961 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.400321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.412268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1314/2634] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:44.417521 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.427869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023fc37-ca26-4769-a45f-81fc378ea643 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.433456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.434326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.434566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.434704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] PATH_INFO: `/v3/projects/fae7d119f8e340f4b5985ee734a1ff89/users/2fc2691bd47a45378cd5f6fe565e8822/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.452800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae7d119f8e340f4b5985ee734a1ff89, user_id=2fc2691bd47a45378cd5f6fe565e8822, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.455613 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.471302 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1321/2635] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:44 2022] PUT /identity/v3/projects/fae7d119f8e340f4b5985ee734a1ff89/users/2fc2691bd47a45378cd5f6fe565e8822/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:44.474650 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.485489 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7e88-9bb2-4c43-938f-3b48752d5210 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.544889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d833-3feb-42a7-a3ab-dff384c64dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.545519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d833-3feb-42a7-a3ab-dff384c64dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.545803 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d833-3feb-42a7-a3ab-dff384c64dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.546080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d833-3feb-42a7-a3ab-dff384c64dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.546771 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d833-3feb-42a7-a3ab-dff384c64dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.548407 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d833-3feb-42a7-a3ab-dff384c64dcb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.559072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1315/2636] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:24:44.563312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.573856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d10f9-08b9-4a32-b187-a67089d5d9b5 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.578559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.579364 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.579695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.580051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] PATH_INFO: `/v3/projects/fae7d119f8e340f4b5985ee734a1ff89/users/2fc2691bd47a45378cd5f6fe565e8822/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.582167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae7d119f8e340f4b5985ee734a1ff89, user_id=2fc2691bd47a45378cd5f6fe565e8822, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.584954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.595860 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1322/2637] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:44 2022] PUT /identity/v3/projects/fae7d119f8e340f4b5985ee734a1ff89/users/2fc2691bd47a45378cd5f6fe565e8822/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:44.606960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d186e5-35ed-4e7c-9fba-f799bea8cb00 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.607244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d186e5-35ed-4e7c-9fba-f799bea8cb00 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.607550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d186e5-35ed-4e7c-9fba-f799bea8cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.637610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-30d186e5-35ed-4e7c-9fba-f799bea8cb00 None None] MFA Rules not processed for user `2fc2691bd47a45378cd5f6fe565e8822`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:44.638822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-30d186e5-35ed-4e7c-9fba-f799bea8cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:44.712658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1316/2638] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:44.724483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.726758 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:44.791642 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde7242-5da7-4680-9dbf-b1eb1f2534a3 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.795369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2090c0f-f6e8-4bb1-af01-8cf638f01a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.795987 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2090c0f-f6e8-4bb1-af01-8cf638f01a9a service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.796271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2090c0f-f6e8-4bb1-af01-8cf638f01a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.796552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2090c0f-f6e8-4bb1-af01-8cf638f01a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.805933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2090c0f-f6e8-4bb1-af01-8cf638f01a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.807587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2090c0f-f6e8-4bb1-af01-8cf638f01a9a service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:44.812715 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:44.818375 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1323/2639] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:44.884525 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d186e5-35ed-4e7c-9fba-f799bea8cb00 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:44.898788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:44.958046 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d186e5-35ed-4e7c-9fba-f799bea8cb00 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:44.963135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:44.963809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:44.964095 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:44.964369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] PATH_INFO: `/v3/users/1397974b15ed49e4b606c5f4e35f640e` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:44.965555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1397974b15ed49e4b606c5f4e35f640e)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:44.967506 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:45.015677 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1397974b15ed49e4b606c5f4e35f640e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.023395 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1397974b15ed49e4b606c5f4e35f640e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.031765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1397974b15ed49e4b606c5f4e35f640e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.032466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1397974b15ed49e4b606c5f4e35f640e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.033072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1397974b15ed49e4b606c5f4e35f640e'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.050843 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1317/2640] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:44 2022] DELETE /identity/v3/users/1397974b15ed49e4b606c5f4e35f640e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:45.055690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:45.056121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:45.056409 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:45.077799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:45.079491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:45.157121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1324/2641] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:45.167239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:45.168671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:45.231319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944be41-95ae-421e-b31d-4ed6e1198484 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:45.235311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:45.235993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:45.236354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:45.236685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:45.246924 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:45.248527 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:45.259045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1318/2642] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:45.546636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:45.548125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:45.560657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293aab0b-4489-42c8-8c1f-191bcde7e2c8 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:45.565604 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:45.566258 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:45.566534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:45.566822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] PATH_INFO: `/v3/projects/62114fbcedc44ba2a46e210576667750` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:45.568314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=62114fbcedc44ba2a46e210576667750)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:45.571418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:45.622003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62114fbcedc44ba2a46e210576667750', 'request_id': 'req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.627925 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62114fbcedc44ba2a46e210576667750', 'request_id': 'req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.636257 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62114fbcedc44ba2a46e210576667750', 'request_id': 'req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.649702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] The token cache is being invalidate because project 62114fbcedc44ba2a46e210576667750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:45.649986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.650630 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.652467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1325/2643] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:45 2022] DELETE /identity/v3/projects/62114fbcedc44ba2a46e210576667750 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:45.656566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:45.667738 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0de5d5-9b48-4f97-a13d-540d8a44e637 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:45.701362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:45.730957 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:45.731721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:45.731942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:45.732196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] PATH_INFO: `/v3/users/2fc2691bd47a45378cd5f6fe565e8822` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:45.733535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc2691bd47a45378cd5f6fe565e8822)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:45.735623 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:45.791446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc2691bd47a45378cd5f6fe565e8822'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.799699 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc2691bd47a45378cd5f6fe565e8822'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.807047 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc2691bd47a45378cd5f6fe565e8822'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.819498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc2691bd47a45378cd5f6fe565e8822'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.819498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc2691bd47a45378cd5f6fe565e8822'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:45.826043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1319/2644] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:45 2022] DELETE /identity/v3/users/2fc2691bd47a45378cd5f6fe565e8822 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:46.097015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.098450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:46.112085 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e094a-5dcf-4a12-a283-ff6015dc4d6e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.168213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.168858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.169142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.169420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] PATH_INFO: `/v3/projects/fae7d119f8e340f4b5985ee734a1ff89` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.170566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae7d119f8e340f4b5985ee734a1ff89)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.172569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.203824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:46.216816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.218242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:46.223586 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae7d119f8e340f4b5985ee734a1ff89', 'request_id': 'req-40dbafdc-da1f-4642-8d1c-d072d62a978c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.230300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae7d119f8e340f4b5985ee734a1ff89', 'request_id': 'req-40dbafdc-da1f-4642-8d1c-d072d62a978c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.232348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da5b4e-9a1a-4b94-8e1a-74bdf7a9fcca admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.238014 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae7d119f8e340f4b5985ee734a1ff89', 'request_id': 'req-40dbafdc-da1f-4642-8d1c-d072d62a978c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.249755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] The token cache is being invalidate because project fae7d119f8e340f4b5985ee734a1ff89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:46.250074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.250702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-40dbafdc-da1f-4642-8d1c-d072d62a978c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.252237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1326/2645] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:46 2022] DELETE /identity/v3/projects/fae7d119f8e340f4b5985ee734a1ff89 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:46.257430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cdca1-8f09-4d94-8011-71eada419186 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.257710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cdca1-8f09-4d94-8011-71eada419186 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.257974 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cdca1-8f09-4d94-8011-71eada419186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.277457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-cd6cdca1-8f09-4d94-8011-71eada419186 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:46.278657 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-cd6cdca1-8f09-4d94-8011-71eada419186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:46.292935 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.293581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.293891 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.294170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] PATH_INFO: `/v3/users/93d7d3b63577463b8285a81d7afd37d1` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.295374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d7d3b63577463b8285a81d7afd37d1)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.297307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.343513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1327/2646] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:46.344666 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d7d3b63577463b8285a81d7afd37d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.352983 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d7d3b63577463b8285a81d7afd37d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.355724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:46.363182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d7d3b63577463b8285a81d7afd37d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.364316 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d7d3b63577463b8285a81d7afd37d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.365012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae4de7a5-83dc-4256-867f-38a05359c482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d7d3b63577463b8285a81d7afd37d1'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:46.388517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1320/2647] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:46 2022] DELETE /identity/v3/users/93d7d3b63577463b8285a81d7afd37d1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:46.392890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.393181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.393460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.412920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3d1d-98a8-4746-98fd-09753ea1e42a None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.413204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3d1d-98a8-4746-98fd-09753ea1e42a None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.413405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:46.413542 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3d1d-98a8-4746-98fd-09753ea1e42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.415313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:46.433763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-f8cf3d1d-98a8-4746-98fd-09753ea1e42a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:46.434952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f8cf3d1d-98a8-4746-98fd-09753ea1e42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:46.480935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1328/2648] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:46.492629 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.494413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:46.501462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1321/2649] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:46.505856 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3d1d-98a8-4746-98fd-09753ea1e42a None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.515578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3d1d-98a8-4746-98fd-09753ea1e42a None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.520990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.521610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.521894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.522390 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.523039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:46.523388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.525329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.542465 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1322/2650] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:24:46.546963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.557762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef66d96-0c3d-42c9-9104-066b9292008e None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.558593 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f3db-55cb-4fc1-85d7-7530d4b1ad46 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.561697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.562520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.562804 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.563084 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.563385 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.564032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.564386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.564668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.565325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.567227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.575467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.577050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.581956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:46.591234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1329/2651] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:24:46.609098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1323/2652] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:46 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:24:46.610405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.625791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9874aa-1c22-46e4-826d-e44826def3b7 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.710802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.710802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.711182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.711498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.713413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.716387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.754370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1330/2653] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:46 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:46.759502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.775890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f23b2f-0c3b-444c-92e3-44018a3d8c07 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.786135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.786841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.787205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.787610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.788455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.790168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.810061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1324/2654] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:46.813801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.825910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1ea6-d64f-4851-a54c-c67b342e7c58 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.832374 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf1cd-1a02-4ab5-bf0d-6482ca53760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.833197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf1cd-1a02-4ab5-bf0d-6482ca53760f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.833465 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf1cd-1a02-4ab5-bf0d-6482ca53760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.833765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf1cd-1a02-4ab5-bf0d-6482ca53760f admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.834529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf1cd-1a02-4ab5-bf0d-6482ca53760f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.838552 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf1cd-1a02-4ab5-bf0d-6482ca53760f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.848583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1331/2655] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:46.852786 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.863830 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cfbaf-7f0e-4989-af43-559b51bae3e8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:46.868977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:46.869668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.869946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.870219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] PATH_INFO: `/v3/projects/58c19f1fe7614c8483732c53460fdf19/users/55b03317f64247c98925614cf332ce7c/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.887064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c19f1fe7614c8483732c53460fdf19, user_id=55b03317f64247c98925614cf332ce7c, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:46.889966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:46.906643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1325/2656] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:46 2022] PUT /identity/v3/projects/58c19f1fe7614c8483732c53460fdf19/users/55b03317f64247c98925614cf332ce7c/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:46.917393 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:46.917685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:46.918064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:46.925012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:46.928605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:46.949382 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] MFA Rules not processed for user `55b03317f64247c98925614cf332ce7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:46.950731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:47.008631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779365cd-f161-4c58-9ca1-db2b3805c29d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:47.013431 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:47.014076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:47.014360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:47.014636 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] PATH_INFO: `/v3/projects/41a0bfa0c36a4e04835b33a5794a1314` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:47.015838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a0bfa0c36a4e04835b33a5794a1314)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:47.017819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:47.020396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1332/2657] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:47.025831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:47.032868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:47.034391 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:47.068560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a0bfa0c36a4e04835b33a5794a1314', 'request_id': 'req-d760ade9-d12b-480a-828f-483d1e130d83'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.080906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a0bfa0c36a4e04835b33a5794a1314', 'request_id': 'req-d760ade9-d12b-480a-828f-483d1e130d83'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.088207 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a0bfa0c36a4e04835b33a5794a1314', 'request_id': 'req-d760ade9-d12b-480a-828f-483d1e130d83'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.093558 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb43e5-e920-49f8-b674-879c3ab008e6 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:47.100044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] The token cache is being invalidate because project 41a0bfa0c36a4e04835b33a5794a1314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:47.100354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.101030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.102547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1326/2658] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:46 2022] DELETE /identity/v3/projects/41a0bfa0c36a4e04835b33a5794a1314 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:47.112580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:47.149505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabccdb4-a37c-40dd-8343-0ff90145c0da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:47.150151 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabccdb4-a37c-40dd-8343-0ff90145c0da service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:47.150428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabccdb4-a37c-40dd-8343-0ff90145c0da service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:47.150700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabccdb4-a37c-40dd-8343-0ff90145c0da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:47.152610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fabccdb4-a37c-40dd-8343-0ff90145c0da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:47.218376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabccdb4-a37c-40dd-8343-0ff90145c0da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:47.220181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabccdb4-a37c-40dd-8343-0ff90145c0da service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:47.230770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1333/2659] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:24:47.252421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:47.253946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:47.324343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ade9-d12b-480a-828f-483d1e130d83 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:47.329464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:47.330129 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:47.330414 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:47.330696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] PATH_INFO: `/v3/users/55b03317f64247c98925614cf332ce7c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:47.331926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b03317f64247c98925614cf332ce7c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:47.334004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:47.385423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b03317f64247c98925614cf332ce7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.392555 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b03317f64247c98925614cf332ce7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.399765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b03317f64247c98925614cf332ce7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.400398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b03317f64247c98925614cf332ce7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.401010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b03317f64247c98925614cf332ce7c'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.419026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1327/2660] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:47 2022] DELETE /identity/v3/users/55b03317f64247c98925614cf332ce7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:47.423690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:47.424008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:47.424289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:47.443800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:47.445049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:47.503894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1334/2661] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:47.513721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:47.515155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:47.529713 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:47.575654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d445c-61b7-4bf2-9c20-e2b84e55a5a7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:47.579202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94898d6-797c-48b6-9407-4ec9ff57a1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:47.579842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94898d6-797c-48b6-9407-4ec9ff57a1bb service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:47.580125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94898d6-797c-48b6-9407-4ec9ff57a1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:47.580402 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94898d6-797c-48b6-9407-4ec9ff57a1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:47.589306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94898d6-797c-48b6-9407-4ec9ff57a1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:47.590739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94898d6-797c-48b6-9407-4ec9ff57a1bb service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:47.600868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1328/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:47.880053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:47.881644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:47.906116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a8ba4-49a6-48b7-9085-894fb458313a None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:47.914585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:47.915247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:47.915592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:47.915872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] PATH_INFO: `/v3/projects/58c19f1fe7614c8483732c53460fdf19` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:47.917052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c19f1fe7614c8483732c53460fdf19)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:47.918973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:47.973929 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c19f1fe7614c8483732c53460fdf19', 'request_id': 'req-6b31cd37-6c23-4b25-8c27-051b0285b1ca'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.981453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c19f1fe7614c8483732c53460fdf19', 'request_id': 'req-6b31cd37-6c23-4b25-8c27-051b0285b1ca'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:47.997828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c19f1fe7614c8483732c53460fdf19', 'request_id': 'req-6b31cd37-6c23-4b25-8c27-051b0285b1ca'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:48.008243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:48.013100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] The token cache is being invalidate because project 58c19f1fe7614c8483732c53460fdf19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:48.013837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:48.014673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6b31cd37-6c23-4b25-8c27-051b0285b1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:48.016864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1335/2663] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:47 2022] DELETE /identity/v3/projects/58c19f1fe7614c8483732c53460fdf19 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:48.023932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552327fc-8aad-4a18-bb52-022207bb5a20 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.024219 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552327fc-8aad-4a18-bb52-022207bb5a20 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.024521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552327fc-8aad-4a18-bb52-022207bb5a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.044607 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-552327fc-8aad-4a18-bb52-022207bb5a20 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:48.045809 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-552327fc-8aad-4a18-bb52-022207bb5a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:48.105769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1329/2664] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:48.113526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555c64-312c-4639-b7bc-d38b33054fad None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.113852 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555c64-312c-4639-b7bc-d38b33054fad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.114156 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555c64-312c-4639-b7bc-d38b33054fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.135193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-13555c64-312c-4639-b7bc-d38b33054fad None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:48.136430 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-13555c64-312c-4639-b7bc-d38b33054fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:48.145457 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1336/2665] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:48.150361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552327fc-8aad-4a18-bb52-022207bb5a20 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:48.160170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552327fc-8aad-4a18-bb52-022207bb5a20 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:48.165437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:48.166065 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.166347 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.166628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.167363 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:48.167681 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:48.169349 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:48.182249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1330/2666] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:24:48.186531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555c64-312c-4639-b7bc-d38b33054fad None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:48.196815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555c64-312c-4639-b7bc-d38b33054fad None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:48.201493 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:48.202102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.202394 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.202674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.203370 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:48.205291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:48.233386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1337/2667] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:48 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:48.237537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:48.247355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111245c1-ee97-495c-8bde-d450a41c1810 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:48.303691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:48.304364 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.304485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.304750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.305418 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:48.307430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:48.328178 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1331/2668] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:48 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:48.332340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:48.342598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94fd28-22b1-4d8a-9e14-5aa99ade19f7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:48.347661 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:48.348272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.348554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.348829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.349525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:48.351895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:48.361696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1338/2669] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:48.365493 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:48.375889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6fb8-0e0b-447f-9f55-d3067447b0bf admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:48.381806 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70edda8-c52a-49e5-b908-38d5aaec88b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:48.382403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70edda8-c52a-49e5-b908-38d5aaec88b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.382729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70edda8-c52a-49e5-b908-38d5aaec88b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.383045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70edda8-c52a-49e5-b908-38d5aaec88b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.384147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70edda8-c52a-49e5-b908-38d5aaec88b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:48.385736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70edda8-c52a-49e5-b908-38d5aaec88b2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:48.397853 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1332/2670] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:48.401980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:48.411935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f1b4-8e89-4dc9-bb75-2b0e0803192e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:48.417340 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:48.417991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.418274 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.418549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] PATH_INFO: `/v3/projects/900f36ef67d04c1ab196c252f1bda103/users/84909a4d4cb94f40a0e4b79e1e45e3d2/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.433525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=900f36ef67d04c1ab196c252f1bda103, user_id=84909a4d4cb94f40a0e4b79e1e45e3d2, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:48.436251 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:48.448834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1339/2671] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:48 2022] PUT /identity/v3/projects/900f36ef67d04c1ab196c252f1bda103/users/84909a4d4cb94f40a0e4b79e1e45e3d2/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:48.453995 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97b9e-92fd-4839-9807-d01eaaac6fb3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.454290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97b9e-92fd-4839-9807-d01eaaac6fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.454572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97b9e-92fd-4839-9807-d01eaaac6fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.474450 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-00c97b9e-92fd-4839-9807-d01eaaac6fb3 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:48.476189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-00c97b9e-92fd-4839-9807-d01eaaac6fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:48.493647 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:48.538162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1333/2672] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:48.547910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:48.549634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:48.606587 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6480c-1494-4c2a-8124-ba0cc6cdb48b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:48.610353 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:48.610985 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:48.611313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:48.611641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:48.621765 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:48.623289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:48.633021 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1340/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:52.774545 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698279f6-238c-4428-aefa-f234a8381fd6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:52.775097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698279f6-238c-4428-aefa-f234a8381fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:52.775097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698279f6-238c-4428-aefa-f234a8381fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:52.805453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-698279f6-238c-4428-aefa-f234a8381fd6 None None] MFA Rules not processed for user `84909a4d4cb94f40a0e4b79e1e45e3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:52.807378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-698279f6-238c-4428-aefa-f234a8381fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:52.884932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1334/2674] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:52.889154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:52.900563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf427-f293-4621-bdff-ed8faa61c0cd service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:52.905406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:52.906131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:52.906482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:52.906828 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:52.907616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:52.909663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:52.943315 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1341/2675] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:52 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:52.947639 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698279f6-238c-4428-aefa-f234a8381fd6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:52.959001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698279f6-238c-4428-aefa-f234a8381fd6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:53.055288 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:53.056214 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:53.056566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:53.056908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:53.057657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:53.060225 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:53.092056 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1335/2676] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:52 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:53.096296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:53.109638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cac87b-b4ef-48aa-8d2c-82178c9c5976 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:53.114523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:53.115209 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:53.116647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:53.117101 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:53.117909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:53.119846 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:53.135348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1342/2677] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:53.136854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:53.147236 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3cfc8-c65f-4d21-b014-1375ba6037d1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:53.152156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:53.152845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:53.153125 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:53.153403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] PATH_INFO: `/v3/projects/1f82b7d21cfc403e92fbc193cdcbe391/users/9cc673324d734683b0126025cac2464f/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:53.170461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f82b7d21cfc403e92fbc193cdcbe391, user_id=9cc673324d734683b0126025cac2464f, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:53.173341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:53.198094 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1336/2678] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:53 2022] PUT /identity/v3/projects/1f82b7d21cfc403e92fbc193cdcbe391/users/9cc673324d734683b0126025cac2464f/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:53.198762 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:53.221530 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016455de-87ea-4ff3-9530-0b23c7590136 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:53.339989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:53.340772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:53.341117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:53.341401 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:53.342155 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:53.343919 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:53.359304 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1343/2679] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:53.364729 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:53.376766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04389-2221-4cac-8d8a-a0a6d1da6e09 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:53.382634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a507-5069-4e04-bd1b-ac7a054a8a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:53.383155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a507-5069-4e04-bd1b-ac7a054a8a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:53.383470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a507-5069-4e04-bd1b-ac7a054a8a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:53.383747 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a507-5069-4e04-bd1b-ac7a054a8a27 admin admin] PATH_INFO: `/v3/projects/1f82b7d21cfc403e92fbc193cdcbe391/users/9cc673324d734683b0126025cac2464f/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:53.385875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588a507-5069-4e04-bd1b-ac7a054a8a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f82b7d21cfc403e92fbc193cdcbe391, user_id=9cc673324d734683b0126025cac2464f, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:53.389145 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588a507-5069-4e04-bd1b-ac7a054a8a27 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:53.402832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1337/2680] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:53 2022] PUT /identity/v3/projects/1f82b7d21cfc403e92fbc193cdcbe391/users/9cc673324d734683b0126025cac2464f/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:54.395464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:54.397986 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:54.406003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:54.413569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a93a4-0a62-4c51-b0e8-0f396a87d324 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:54.479520 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:54.480434 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:54.480786 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:54.481130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] PATH_INFO: `/v3/users/c12f7568d0924bbe9b4b539d7e7185f4` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:54.482438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12f7568d0924bbe9b4b539d7e7185f4)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:54.484567 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:54.573991 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12f7568d0924bbe9b4b539d7e7185f4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:54.574784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12f7568d0924bbe9b4b539d7e7185f4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:54.576087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12f7568d0924bbe9b4b539d7e7185f4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:54.597250 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12f7568d0924bbe9b4b539d7e7185f4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:54.605948 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12f7568d0924bbe9b4b539d7e7185f4'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:54.636027 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1344/2681] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:54 2022] DELETE /identity/v3/users/c12f7568d0924bbe9b4b539d7e7185f4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:54.640330 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:54.640842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:54.640933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:54.650930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:54.671752 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:54.673367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:54.751921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1338/2682] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:54.765376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:54.767395 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:54.849585 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a38b-1248-4f8d-9a4d-2749c9a4cb91 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:54.854785 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:54.855149 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:54.855562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:54.855945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:54.868638 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:54.870240 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:54.882798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1345/2683] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:55.258562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:55.260654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:55.281173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116829d-27b5-40d9-8413-41389623ee00 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:55.321114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:55.321777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:55.322221 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:55.323164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] PATH_INFO: `/v3/projects/ed59d20d85c34229bf09bfb14de381dd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:55.326788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed59d20d85c34229bf09bfb14de381dd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:55.335372 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:55.394600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed59d20d85c34229bf09bfb14de381dd', 'request_id': 'req-66aa7569-1582-4ec9-a274-b29d17441d21'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.404488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed59d20d85c34229bf09bfb14de381dd', 'request_id': 'req-66aa7569-1582-4ec9-a274-b29d17441d21'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.411204 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed59d20d85c34229bf09bfb14de381dd', 'request_id': 'req-66aa7569-1582-4ec9-a274-b29d17441d21'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.434149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] The token cache is being invalidate because project ed59d20d85c34229bf09bfb14de381dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:55.434149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.435679 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.438361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1339/2684] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:55 2022] DELETE /identity/v3/projects/ed59d20d85c34229bf09bfb14de381dd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:55.442020 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:55.453254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232d8f-5016-411a-8a7e-408187a429d8 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:55.477601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:55.525702 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:55.526480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:55.526831 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:55.527177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] PATH_INFO: `/v3/users/429c6f3b96674a74809af1390027392c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:55.528731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429c6f3b96674a74809af1390027392c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:55.530894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:55.591331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429c6f3b96674a74809af1390027392c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.593237 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429c6f3b96674a74809af1390027392c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.593825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429c6f3b96674a74809af1390027392c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.609386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429c6f3b96674a74809af1390027392c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.620845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-7afa0139-5a97-4e0c-8bde-57a509fac2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429c6f3b96674a74809af1390027392c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:55.652186 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1346/2685] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:55 2022] DELETE /identity/v3/users/429c6f3b96674a74809af1390027392c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:24:56.090626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:56.092308 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:56.113326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa7569-1582-4ec9-a274-b29d17441d21 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:56.301702 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:56.302400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:56.302997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:56.302997 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] PATH_INFO: `/v3/projects/f4ca1f0c9c844980b60391d43e1e153c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:56.311296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ca1f0c9c844980b60391d43e1e153c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:56.313271 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:56.383628 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:56.432180 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ca1f0c9c844980b60391d43e1e153c', 'request_id': 'req-a3c75707-631d-40bc-ba50-50af760e5c60'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:56.459780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ca1f0c9c844980b60391d43e1e153c', 'request_id': 'req-a3c75707-631d-40bc-ba50-50af760e5c60'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:56.469342 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ca1f0c9c844980b60391d43e1e153c', 'request_id': 'req-a3c75707-631d-40bc-ba50-50af760e5c60'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:56.491526 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] The token cache is being invalidate because project f4ca1f0c9c844980b60391d43e1e153c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:24:56.492185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:56.493067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a3c75707-631d-40bc-ba50-50af760e5c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:56.495748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1340/2686] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:24:56 2022] DELETE /identity/v3/projects/f4ca1f0c9c844980b60391d43e1e153c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:56.500500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d27f2-161a-4728-9ef2-7101017b2587 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:56.501331 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d27f2-161a-4728-9ef2-7101017b2587 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:56.501827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d27f2-161a-4728-9ef2-7101017b2587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:56.528291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f83d27f2-161a-4728-9ef2-7101017b2587 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:56.529845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f83d27f2-161a-4728-9ef2-7101017b2587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:56.624433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1347/2687] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:56.634423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826360a6-88ce-47c4-9500-f9c492300c8c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:56.634721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826360a6-88ce-47c4-9500-f9c492300c8c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:56.635229 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826360a6-88ce-47c4-9500-f9c492300c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:56.662906 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-826360a6-88ce-47c4-9500-f9c492300c8c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:56.664688 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-826360a6-88ce-47c4-9500-f9c492300c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:56.678408 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d27f2-161a-4728-9ef2-7101017b2587 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:56.685683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1341/2688] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:56.690444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d27f2-161a-4728-9ef2-7101017b2587 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:56.696307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:56.697301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:56.697792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:56.698232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:56.699165 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:24:56.706656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:56.708843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:56.730942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826360a6-88ce-47c4-9500-f9c492300c8c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:56.754413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1348/2689] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 04:24:56.755590 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826360a6-88ce-47c4-9500-f9c492300c8c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:56.762619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:56.763632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:56.764075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:56.764503 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:56.766138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:56.768357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:56.811914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1342/2690] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:56 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:56.817166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:56.834213 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72adb-8a5e-4e8b-9ad0-3447e94505dc admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:56.909830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:56.977082 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:56.978037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:56.978321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:56.978598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:56.980535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:56.983056 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:57.018412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1349/2691] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:56 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:57.022524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:57.038785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ce3ec-885b-4d0a-b137-5fe177940f95 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:57.057239 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:57.057878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:57.061784 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:57.062071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:57.062791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:57.070886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:57.103728 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1343/2692] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:57.104617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:57.117049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a5d00-2e1d-4e00-ad9e-479285091e27 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:57.143692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441aa6f-c8b2-4522-95be-0a47502a0125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:57.144386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441aa6f-c8b2-4522-95be-0a47502a0125 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:57.144673 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441aa6f-c8b2-4522-95be-0a47502a0125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:57.144951 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441aa6f-c8b2-4522-95be-0a47502a0125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:57.145696 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441aa6f-c8b2-4522-95be-0a47502a0125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:57.152829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441aa6f-c8b2-4522-95be-0a47502a0125 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:57.173407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1350/2693] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:24:57.178967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:57.191536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa41d-0cac-4264-9c6f-45b328f5e47c admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:57.201064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:57.201808 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:57.202053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:57.202515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] PATH_INFO: `/v3/projects/bb09b8520a624a4697ed350a4823a43b/users/328be45bd8114c3684b7f99942ccdfaf/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:57.242463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb09b8520a624a4697ed350a4823a43b, user_id=328be45bd8114c3684b7f99942ccdfaf, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:57.245534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:57.292588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26cdd-3145-4160-b4c6-9e10716e3d7d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:57.292882 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26cdd-3145-4160-b4c6-9e10716e3d7d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:57.293211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26cdd-3145-4160-b4c6-9e10716e3d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:57.300664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1344/2694] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:57 2022] PUT /identity/v3/projects/bb09b8520a624a4697ed350a4823a43b/users/328be45bd8114c3684b7f99942ccdfaf/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:57.338359 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-abc26cdd-3145-4160-b4c6-9e10716e3d7d None None] MFA Rules not processed for user `328be45bd8114c3684b7f99942ccdfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:57.339826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-abc26cdd-3145-4160-b4c6-9e10716e3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:57.467362 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1351/2695] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:24:57.472335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:57.618319 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af94fb-2bde-4e6f-9274-75f449832205 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:57.629379 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:57.630307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:57.631579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:57.632106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:57.633336 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:57.636731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:57.672581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1345/2696] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:24:57 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:57.676950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26cdd-3145-4160-b4c6-9e10716e3d7d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:57.694350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26cdd-3145-4160-b4c6-9e10716e3d7d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:57.861591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:57.862241 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:57.862711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:57.863001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:57.864144 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:57.868829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:57.907389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1352/2697] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:24:57 2022] POST /identity/v3/users => generated 300 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:24:57.911455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:57.932273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f583f-5857-47b3-92f8-b7061f40e011 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:57.946649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:57.947787 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:57.948358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:57.948876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:57.956277 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:57.958748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:57.983403 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1346/2698] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:57.987529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:58.040791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad23c0-4478-4a1c-8e77-8a352f6aed64 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:58.047347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:58.048523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:58.048957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:58.049404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] PATH_INFO: `/v3/projects/63cfba6c646344c58723a05c9ee65637/users/1671cb0e36ae4f6f89d68ecaf75c59de/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:58.071508 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cfba6c646344c58723a05c9ee65637, user_id=1671cb0e36ae4f6f89d68ecaf75c59de, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:58.076683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:58.113111 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1353/2699] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:57 2022] PUT /identity/v3/projects/63cfba6c646344c58723a05c9ee65637/users/1671cb0e36ae4f6f89d68ecaf75c59de/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:58.117836 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:58.135398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0215b-0d9e-4b39-b29a-6e18ff250e2e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:58.191211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:58.256675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3e500-8984-4347-a6ea-eeca54a77ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:58.257498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e500-8984-4347-a6ea-eeca54a77ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:58.257785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e500-8984-4347-a6ea-eeca54a77ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:58.258063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3e500-8984-4347-a6ea-eeca54a77ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:58.258769 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3e500-8984-4347-a6ea-eeca54a77ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:58.261423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3e500-8984-4347-a6ea-eeca54a77ae6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:58.281032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1347/2700] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:24:58.285035 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:58.297381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:58.302044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9332b0-e099-49ee-9210-6dbbc81c7809 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:58.317034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:58.318002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:58.318695 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:58.319081 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] PATH_INFO: `/v3/projects/63cfba6c646344c58723a05c9ee65637/users/1671cb0e36ae4f6f89d68ecaf75c59de/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:58.322625 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cfba6c646344c58723a05c9ee65637, user_id=1671cb0e36ae4f6f89d68ecaf75c59de, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:58.326871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:58.362512 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1354/2701] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:24:58 2022] PUT /identity/v3/projects/63cfba6c646344c58723a05c9ee65637/users/1671cb0e36ae4f6f89d68ecaf75c59de/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:58.372927 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726dd7c-2cb1-4a5d-a5a5-39e24b385744 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:58.373222 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726dd7c-2cb1-4a5d-a5a5-39e24b385744 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:58.373490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726dd7c-2cb1-4a5d-a5a5-39e24b385744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:58.415302 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-4726dd7c-2cb1-4a5d-a5a5-39e24b385744 None None] MFA Rules not processed for user `1671cb0e36ae4f6f89d68ecaf75c59de`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:58.417117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4726dd7c-2cb1-4a5d-a5a5-39e24b385744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:58.540697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1348/2702] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:24:58.556469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:58.558893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:24:58.666764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca20036-2e4c-4abb-a719-f50f3198b807 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:58.671843 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b46d4-653b-415d-b8bf-3612694c39d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:58.673181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b46d4-653b-415d-b8bf-3612694c39d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:58.673634 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b46d4-653b-415d-b8bf-3612694c39d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:58.674278 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b46d4-653b-415d-b8bf-3612694c39d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:58.689065 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b46d4-653b-415d-b8bf-3612694c39d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:58.692222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b46d4-653b-415d-b8bf-3612694c39d4 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:58.707529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1355/2703] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:24:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:24:59.635394 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726dd7c-2cb1-4a5d-a5a5-39e24b385744 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:24:59.745663 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726dd7c-2cb1-4a5d-a5a5-39e24b385744 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:24:59.753919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:24:59.754691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:59.755080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:59.755511 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] PATH_INFO: `/v3/users/328be45bd8114c3684b7f99942ccdfaf` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:59.757580 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328be45bd8114c3684b7f99942ccdfaf)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:24:59.759942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:24:59.858043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328be45bd8114c3684b7f99942ccdfaf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:59.872734 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:24:59.882032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328be45bd8114c3684b7f99942ccdfaf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:59.897641 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328be45bd8114c3684b7f99942ccdfaf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:59.898415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328be45bd8114c3684b7f99942ccdfaf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:59.899023 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328be45bd8114c3684b7f99942ccdfaf'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:24:59.925108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1349/2704] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:24:59 2022] DELETE /identity/v3/users/328be45bd8114c3684b7f99942ccdfaf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:24:59.928407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:24:59.929545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:24:59.930048 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:24:59.964438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:24:59.966091 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:00.059982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1356/2705] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:00.070409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:00.076248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:00.156468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d03b-9642-4422-a4ac-8959e69aed88 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:00.160691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:00.161433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:00.161832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:00.162188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:00.173533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:00.175186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:00.187951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1350/2706] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:00.730883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:00.732626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:00.748934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6867366-8ec9-40f2-bf41-ab305c4c2123 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:00.754265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:00.755028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:00.755511 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:00.756090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] PATH_INFO: `/v3/projects/bb09b8520a624a4697ed350a4823a43b` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:00.757665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb09b8520a624a4697ed350a4823a43b)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:00.760031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:00.829384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb09b8520a624a4697ed350a4823a43b', 'request_id': 'req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:00.836248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb09b8520a624a4697ed350a4823a43b', 'request_id': 'req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:00.851871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb09b8520a624a4697ed350a4823a43b', 'request_id': 'req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:00.865809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] The token cache is being invalidate because project bb09b8520a624a4697ed350a4823a43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:00.866105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:00.866777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f6117065-3c70-4891-a1f2-2bc1c1e4de8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:00.868324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1357/2707] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:00 2022] DELETE /identity/v3/projects/bb09b8520a624a4697ed350a4823a43b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:00.872333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:00.882844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0349-b2d9-4465-898b-6b2ebbb606c4 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:00.938208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:00.938706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:00.938857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:00.957916 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:00.958691 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:00.959879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:00.960171 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] PATH_INFO: `/v3/users/1671cb0e36ae4f6f89d68ecaf75c59de` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:00.961368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1671cb0e36ae4f6f89d68ecaf75c59de)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:00.963343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:00.968505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] MFA Rules not processed for user `9cc673324d734683b0126025cac2464f`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:00.970017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:00.975193 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:01.012323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1671cb0e36ae4f6f89d68ecaf75c59de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.020122 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1671cb0e36ae4f6f89d68ecaf75c59de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.028877 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1671cb0e36ae4f6f89d68ecaf75c59de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.029572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1671cb0e36ae4f6f89d68ecaf75c59de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.030179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1671cb0e36ae4f6f89d68ecaf75c59de'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.044742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:01.054905 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1358/2708] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:01.057810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1351/2709] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:00 2022] DELETE /identity/v3/users/1671cb0e36ae4f6f89d68ecaf75c59de => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:01.061247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:01.062976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:01.152979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8ddfd-24c4-4ea3-b151-2e85d0fa598b None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:01.226579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602ea87-7570-4ffd-8354-781886b5eefd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:01.227293 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ea87-7570-4ffd-8354-781886b5eefd service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:01.227577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ea87-7570-4ffd-8354-781886b5eefd service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:01.227855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ea87-7570-4ffd-8354-781886b5eefd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:01.229836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7602ea87-7570-4ffd-8354-781886b5eefd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:01.277536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:01.297350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602ea87-7570-4ffd-8354-781886b5eefd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:01.299002 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602ea87-7570-4ffd-8354-781886b5eefd service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:01.319482 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1359/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:25:01.352532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:01.354327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:01.442274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c60444-8b93-4c0c-a789-001ee10aa0cb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:01.448043 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:01.448816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:01.449097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:01.449408 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] PATH_INFO: `/v3/projects/63cfba6c646344c58723a05c9ee65637` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:01.451029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cfba6c646344c58723a05c9ee65637)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:01.453901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:01.518368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cfba6c646344c58723a05c9ee65637', 'request_id': 'req-a84479b4-564d-48cb-ab99-12084260575a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.528921 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cfba6c646344c58723a05c9ee65637', 'request_id': 'req-a84479b4-564d-48cb-ab99-12084260575a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.535513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cfba6c646344c58723a05c9ee65637', 'request_id': 'req-a84479b4-564d-48cb-ab99-12084260575a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.550948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] The token cache is being invalidate because project 63cfba6c646344c58723a05c9ee65637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:01.551813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.552704 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a84479b4-564d-48cb-ab99-12084260575a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:01.559464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1352/2711] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:01 2022] DELETE /identity/v3/projects/63cfba6c646344c58723a05c9ee65637 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:01.561092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d0d8-eb88-4f7f-af96-e88a3aa7b294 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:01.564755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d0d8-eb88-4f7f-af96-e88a3aa7b294 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:01.564755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d0d8-eb88-4f7f-af96-e88a3aa7b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:01.605770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-62e8d0d8-eb88-4f7f-af96-e88a3aa7b294 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:01.611935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-62e8d0d8-eb88-4f7f-af96-e88a3aa7b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:01.728776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1360/2712] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:01.737045 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55f83-e91d-4048-a90e-d0720e998d7e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:01.737336 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55f83-e91d-4048-a90e-d0720e998d7e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:01.737612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55f83-e91d-4048-a90e-d0720e998d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:01.771831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-74b55f83-e91d-4048-a90e-d0720e998d7e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:01.774238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-74b55f83-e91d-4048-a90e-d0720e998d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:01.793575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d0d8-eb88-4f7f-af96-e88a3aa7b294 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:01.800936 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1353/2713] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:01.806134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d0d8-eb88-4f7f-af96-e88a3aa7b294 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:01.821254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:01.822821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:01.823415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:01.823913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:01.825295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:01.825877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:01.828764 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:01.854000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1361/2714] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:01.858375 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55f83-e91d-4048-a90e-d0720e998d7e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:01.871463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55f83-e91d-4048-a90e-d0720e998d7e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:01.884008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:01.887544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:01.888170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:01.888937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:01.889255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:01.889536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:01.890513 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:01.894360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:01.952448 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1354/2715] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:01 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:01.955031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.024709 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5e119-ec53-43a7-9f8e-41168f8d8f7f admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.039674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:02.055626 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb38a4-f9ac-4974-bb29-9c0a9d9c5549 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.067724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.068635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.069053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.069658 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.070017 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.072008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.096397 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.097473 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.098125 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.099276 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.112980 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:02.118740 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1355/2716] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:01 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:02.120291 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.132837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89ee6-0633-4bb3-b9c6-de4d0fc58fbe admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.135964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.137954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.138175 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.139066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.139491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.139841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.140931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.142844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.152279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1362/2717] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:02.159016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1356/2718] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:02.160212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.172441 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda7f2-a035-4dee-8162-8f7c7bd9223c service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.180750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0df9c-1e0f-4ce6-84ce-9c54b9c67c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.181383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0df9c-1e0f-4ce6-84ce-9c54b9c67c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.181667 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0df9c-1e0f-4ce6-84ce-9c54b9c67c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.181939 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0df9c-1e0f-4ce6-84ce-9c54b9c67c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.182639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0df9c-1e0f-4ce6-84ce-9c54b9c67c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.184283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0df9c-1e0f-4ce6-84ce-9c54b9c67c33 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.198271 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1363/2719] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:02.199848 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.210533 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef378c-9b74-4171-9d06-07c624146b87 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.215398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.216175 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.216534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.216913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] PATH_INFO: `/v3/projects/f2416afdddaf4b93b036d59d3fbb9010/users/7688479791504f33ad77c5310c37ac99/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.233290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2416afdddaf4b93b036d59d3fbb9010, user_id=7688479791504f33ad77c5310c37ac99, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.236107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.251486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1357/2720] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:02 2022] PUT /identity/v3/projects/f2416afdddaf4b93b036d59d3fbb9010/users/7688479791504f33ad77c5310c37ac99/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:02.263774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f9a1-2b67-4021-b335-c0e762d577ad None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.264067 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f9a1-2b67-4021-b335-c0e762d577ad None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.264542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f9a1-2b67-4021-b335-c0e762d577ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.294050 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:02.298279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-42d3f9a1-2b67-4021-b335-c0e762d577ad None None] MFA Rules not processed for user `7688479791504f33ad77c5310c37ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:02.301588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-42d3f9a1-2b67-4021-b335-c0e762d577ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:02.380454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1364/2721] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:02.383245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.476887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5024e-3cde-44f2-9aa1-afc2a03f9c83 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.482566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.483298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.483668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.484019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.484785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.487417 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.539064 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1358/2722] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:02.540114 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f9a1-2b67-4021-b335-c0e762d577ad None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.562012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f9a1-2b67-4021-b335-c0e762d577ad None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.661248 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.662793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.662793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.663083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.664170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.666204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.705598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.706979 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1365/2723] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:02 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:25:02.746758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feafa8f-961a-45cb-8c4b-38674283ea76 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.761135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.764011 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.764553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.766296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.767595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.770337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.788548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1359/2724] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:02.790012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.807446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be305821-c8d6-4515-a964-21924e0173fd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.829425 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902e0a9-f451-40f7-80ae-09c29fa64be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.831517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e0a9-f451-40f7-80ae-09c29fa64be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.831832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e0a9-f451-40f7-80ae-09c29fa64be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.832109 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e0a9-f451-40f7-80ae-09c29fa64be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.832886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902e0a9-f451-40f7-80ae-09c29fa64be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.837194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902e0a9-f451-40f7-80ae-09c29fa64be3 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.863799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1366/2725] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:02.864212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:02.877173 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6d115-1660-47f5-b5aa-0f812e70c115 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:02.891610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:02.892386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.892722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.892861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] PATH_INFO: `/v3/projects/42ae577ae4b84158b4b084bd08fd1d6a/users/19cc4de69361454f825865c4e88db1df/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:02.925564 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ae577ae4b84158b4b084bd08fd1d6a, user_id=19cc4de69361454f825865c4e88db1df, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:02.928389 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:02.953472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1360/2726] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:02 2022] PUT /identity/v3/projects/42ae577ae4b84158b4b084bd08fd1d6a/users/19cc4de69361454f825865c4e88db1df/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:02.970497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d3375-049f-4f30-a35a-00ba8301de47 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:02.970788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d3375-049f-4f30-a35a-00ba8301de47 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:02.971074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d3375-049f-4f30-a35a-00ba8301de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:03.075698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-914d3375-049f-4f30-a35a-00ba8301de47 None None] MFA Rules not processed for user `19cc4de69361454f825865c4e88db1df`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:03.080740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-914d3375-049f-4f30-a35a-00ba8301de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:03.249580 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1367/2727] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:03.250689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:03.306439 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978639b-d586-4e49-a799-2cb7fcc04b9d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:03.307044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978639b-d586-4e49-a799-2cb7fcc04b9d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:03.307994 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978639b-d586-4e49-a799-2cb7fcc04b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:03.337252 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c978639b-d586-4e49-a799-2cb7fcc04b9d None None] MFA Rules not processed for user `84909a4d4cb94f40a0e4b79e1e45e3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:03.338698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c978639b-d586-4e49-a799-2cb7fcc04b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:03.344947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:03.420921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1368/2728] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:03.428988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:03.438727 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323448c4-680f-478b-9c84-3c29482f9c26 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:03.449591 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:03.450327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:03.450597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:03.450879 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:03.451656 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:03.460479 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:03.524770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978639b-d586-4e49-a799-2cb7fcc04b9d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:03.530821 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1361/2729] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:03 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:25:03.537399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978639b-d586-4e49-a799-2cb7fcc04b9d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:03.640219 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:03.641069 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:03.641354 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:03.643914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:03.647492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:03.649967 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:03.699718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1369/2730] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:03 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:03.702501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:03.717893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1101f-f480-428c-bafa-03ba21c3647d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:03.723088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:03.723780 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:03.724089 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:03.724376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:03.725326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:03.732612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:03.749227 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1362/2731] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:03.753459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:03.770532 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35a8f1-04b2-42c3-9b7f-d0a45d7843fb admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:03.793612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:03.793935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:03.794222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:03.794499 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] PATH_INFO: `/v3/projects/0d3ad24aa1324b23b378670c54cdc1a5/users/0dde7fbce55e4b4aba80f2abf5bb1468/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:03.827453 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3ad24aa1324b23b378670c54cdc1a5, user_id=0dde7fbce55e4b4aba80f2abf5bb1468, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:03.830633 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:03.864411 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1370/2732] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:03 2022] PUT /identity/v3/projects/0d3ad24aa1324b23b378670c54cdc1a5/users/0dde7fbce55e4b4aba80f2abf5bb1468/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:03.866791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:03.881397 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9483a-74a6-438f-a0a0-88a3f4f7b48e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:04.025296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34484a12-463c-4167-a8bd-2de1de409fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:04.026050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34484a12-463c-4167-a8bd-2de1de409fae admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:04.026258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34484a12-463c-4167-a8bd-2de1de409fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:04.026657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34484a12-463c-4167-a8bd-2de1de409fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:04.027466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34484a12-463c-4167-a8bd-2de1de409fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:04.031547 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34484a12-463c-4167-a8bd-2de1de409fae admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:04.050249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1363/2733] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:04.054791 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:04.068321 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecedfe-ad11-46b0-9fca-3bd050b54a73 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:04.078452 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:04.079953 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:04.080577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:04.081208 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] PATH_INFO: `/v3/projects/0d3ad24aa1324b23b378670c54cdc1a5/users/0dde7fbce55e4b4aba80f2abf5bb1468/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:04.084617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3ad24aa1324b23b378670c54cdc1a5, user_id=0dde7fbce55e4b4aba80f2abf5bb1468, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:04.095938 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:04.127608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1371/2734] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:04 2022] PUT /identity/v3/projects/0d3ad24aa1324b23b378670c54cdc1a5/users/0dde7fbce55e4b4aba80f2abf5bb1468/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:04.128235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13149-d6bc-4453-82ac-b719902f2ac3 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:04.128531 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13149-d6bc-4453-82ac-b719902f2ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:04.128815 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13149-d6bc-4453-82ac-b719902f2ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:04.203393 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-a2c13149-d6bc-4453-82ac-b719902f2ac3 None None] MFA Rules not processed for user `0dde7fbce55e4b4aba80f2abf5bb1468`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:04.205080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a2c13149-d6bc-4453-82ac-b719902f2ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:04.349024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1364/2735] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:04.362145 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:04.363962 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:04.453911 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb6b23-c5b5-420c-a90b-b591341f578b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:04.458779 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:04.460004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:04.460330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:04.460733 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:04.503888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:04.554943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:04.556957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:04.581649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1372/2736] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:06.374067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13149-d6bc-4453-82ac-b719902f2ac3 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:06.392619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13149-d6bc-4453-82ac-b719902f2ac3 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:06.409595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:06.410619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:06.411195 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:06.411894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:06.469610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:06.482141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:06.484131 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:06.507067 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1365/2737] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:06.707738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:06.711092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:06.862498 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ead6d-ecd0-4767-94ec-04d07deec954 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:06.867640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:06.868279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:06.868743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:06.869026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] PATH_INFO: `/v3/users/1f21d428fab64ca68efa4cf114559ff9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:06.870212 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f21d428fab64ca68efa4cf114559ff9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:06.872217 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:06.924934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f21d428fab64ca68efa4cf114559ff9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:06.925621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f21d428fab64ca68efa4cf114559ff9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:06.926361 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f21d428fab64ca68efa4cf114559ff9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:06.944537 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f21d428fab64ca68efa4cf114559ff9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:06.954206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f21d428fab64ca68efa4cf114559ff9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:06.972133 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1373/2738] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:06 2022] DELETE /identity/v3/users/1f21d428fab64ca68efa4cf114559ff9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:07.187309 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.203899 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaedb6-bd57-4422-b5f2-967e2ac276e6 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.251526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.252933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:07.276356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.276917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.277235 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.277561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] PATH_INFO: `/v3/projects/7ff56f92e7094997a43a848efc835ebd` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.278718 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff56f92e7094997a43a848efc835ebd)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.280708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.310598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:07.324857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89850-46b0-4257-8792-b29a766173e4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.329765 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff56f92e7094997a43a848efc835ebd', 'request_id': 'req-d0626bb2-1694-4826-9cd8-fc08db966308'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:07.337550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff56f92e7094997a43a848efc835ebd', 'request_id': 'req-d0626bb2-1694-4826-9cd8-fc08db966308'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:07.343522 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff56f92e7094997a43a848efc835ebd', 'request_id': 'req-d0626bb2-1694-4826-9cd8-fc08db966308'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:07.356863 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] The token cache is being invalidate because project 7ff56f92e7094997a43a848efc835ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:07.357453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:07.358117 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-d0626bb2-1694-4826-9cd8-fc08db966308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:07.359733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1366/2739] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:07 2022] DELETE /identity/v3/projects/7ff56f92e7094997a43a848efc835ebd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:07.365303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4e64-59d8-4b49-8d32-ac8d8eb8de5b None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.365597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4e64-59d8-4b49-8d32-ac8d8eb8de5b None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.365874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4e64-59d8-4b49-8d32-ac8d8eb8de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.381176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.381821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.382102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.382399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.384292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:07.387085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-382d4e64-59d8-4b49-8d32-ac8d8eb8de5b None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:07.388434 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-382d4e64-59d8-4b49-8d32-ac8d8eb8de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:07.458463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.460296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.465689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1367/2740] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:07.473837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c049-5e2d-4ca9-94f5-190ebd526b79 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.474176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c049-5e2d-4ca9-94f5-190ebd526b79 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.474430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c049-5e2d-4ca9-94f5-190ebd526b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.476956 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1374/2741] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:07.496274 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-2fb4c049-5e2d-4ca9-94f5-190ebd526b79 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:07.497504 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-2fb4c049-5e2d-4ca9-94f5-190ebd526b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:07.506250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1368/2742] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:07.511187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.523488 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84872c53-8acd-42c7-bf4a-8dd10d37029e service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.528415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.529093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.529363 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.529641 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.530456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:07.530768 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.532456 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.547296 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1375/2743] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:07.551576 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4c049-5e2d-4ca9-94f5-190ebd526b79 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.562904 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4c049-5e2d-4ca9-94f5-190ebd526b79 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.575136 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.575930 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.576123 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.576463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.577118 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.579050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.610492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:07.615948 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1369/2744] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:07 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:07.620934 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.631477 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd43518-1fdc-498f-b1d8-216f155e19d1 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.697459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.698086 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.698371 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.698650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.699372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.701348 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.723670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1376/2745] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:07 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:07.728369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.738550 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3d77-2e6b-4d7e-9a0f-4caadbc6121a admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.744420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.744929 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.745212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.745485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.746243 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.747951 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.763567 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1370/2746] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:07.767599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.779153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e974c7e-e7ca-461f-91b3-6d201950f36c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.783792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aee2b5-264b-4824-a99f-7339d31dbf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.784420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aee2b5-264b-4824-a99f-7339d31dbf57 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.784704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aee2b5-264b-4824-a99f-7339d31dbf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.784981 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aee2b5-264b-4824-a99f-7339d31dbf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.785678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aee2b5-264b-4824-a99f-7339d31dbf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.787917 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aee2b5-264b-4824-a99f-7339d31dbf57 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.799830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1377/2747] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:07.805268 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.816146 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c3a0-4c5c-4625-a525-765dbd01dde4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:07.820880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:07.821543 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.821824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.822097 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] PATH_INFO: `/v3/projects/a4cbaa1d4b294c4f835bd5650a160d1f/users/bcaffe414aae4569b3d0fcc7ceb81521/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.836892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cbaa1d4b294c4f835bd5650a160d1f, user_id=bcaffe414aae4569b3d0fcc7ceb81521, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:07.839619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:07.854190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1371/2748] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:07 2022] PUT /identity/v3/projects/a4cbaa1d4b294c4f835bd5650a160d1f/users/bcaffe414aae4569b3d0fcc7ceb81521/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:07.864346 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3a91-be1a-4623-8318-4605312485d0 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:07.865182 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3a91-be1a-4623-8318-4605312485d0 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:07.865464 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3a91-be1a-4623-8318-4605312485d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:07.890566 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:07.894714 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c0fa3a91-be1a-4623-8318-4605312485d0 None None] MFA Rules not processed for user `bcaffe414aae4569b3d0fcc7ceb81521`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:07.896666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c0fa3a91-be1a-4623-8318-4605312485d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:07.964677 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1378/2749] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:07.976774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:07.978488 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:08.052396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76fd8-26e6-4541-a2ab-b06462ac6b33 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:08.057862 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472e2df-6766-4d54-8e3e-882a598d1358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:08.058486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e2df-6766-4d54-8e3e-882a598d1358 service nova] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:08.058773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e2df-6766-4d54-8e3e-882a598d1358 service nova] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:08.059053 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e2df-6766-4d54-8e3e-882a598d1358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:08.067147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472e2df-6766-4d54-8e3e-882a598d1358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:08.069616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472e2df-6766-4d54-8e3e-882a598d1358 service nova] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:08.078910 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1372/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:08.306285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3a91-be1a-4623-8318-4605312485d0 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:08.374531 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3a91-be1a-4623-8318-4605312485d0 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:08.378990 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:08.379663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:08.379940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:08.380718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] PATH_INFO: `/v3/users/bcaffe414aae4569b3d0fcc7ceb81521` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:08.381886 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcaffe414aae4569b3d0fcc7ceb81521)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:08.383837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:08.432287 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcaffe414aae4569b3d0fcc7ceb81521'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:08.433015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcaffe414aae4569b3d0fcc7ceb81521'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:08.433649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcaffe414aae4569b3d0fcc7ceb81521'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:08.446438 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcaffe414aae4569b3d0fcc7ceb81521'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:08.453680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcaffe414aae4569b3d0fcc7ceb81521'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:08.467861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1379/2751] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:08 2022] DELETE /identity/v3/users/bcaffe414aae4569b3d0fcc7ceb81521 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:08.472909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:08.473405 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:08.473519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:08.495044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:08.496318 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:08.558215 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1373/2752] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:08.569799 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:08.571312 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:08.598314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:08.634087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b745b-d4e8-4b21-9a8a-48e3467501d7 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:08.638623 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e3d7-acc8-4e28-8990-e988e4c8aca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:08.639647 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e3d7-acc8-4e28-8990-e988e4c8aca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:08.640096 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e3d7-acc8-4e28-8990-e988e4c8aca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:08.640550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e3d7-acc8-4e28-8990-e988e4c8aca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:08.653578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1e3d7-acc8-4e28-8990-e988e4c8aca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:08.655022 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1e3d7-acc8-4e28-8990-e988e4c8aca7 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:08.665617 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1380/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:09.005010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.007322 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:09.028035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999873d-a57e-43d2-9cd5-d3870b52745f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.033233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.033882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.034163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.034442 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] PATH_INFO: `/v3/projects/a4cbaa1d4b294c4f835bd5650a160d1f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.035642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4cbaa1d4b294c4f835bd5650a160d1f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.037933 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.079562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:09.087883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4cbaa1d4b294c4f835bd5650a160d1f', 'request_id': 'req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:09.094918 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4cbaa1d4b294c4f835bd5650a160d1f', 'request_id': 'req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:09.100861 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4cbaa1d4b294c4f835bd5650a160d1f', 'request_id': 'req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:09.111711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] The token cache is being invalidate because project a4cbaa1d4b294c4f835bd5650a160d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:09.112001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:09.112652 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1a404f2c-f466-4aeb-9f69-0ab114a3bb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:09.114161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1374/2754] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:09 2022] DELETE /identity/v3/projects/a4cbaa1d4b294c4f835bd5650a160d1f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:09.120869 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bc95-7dd4-4e6b-b5df-d6d308c7d39d None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.121388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bc95-7dd4-4e6b-b5df-d6d308c7d39d None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.121491 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bc95-7dd4-4e6b-b5df-d6d308c7d39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.141451 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3003bc95-7dd4-4e6b-b5df-d6d308c7d39d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:09.142716 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3003bc95-7dd4-4e6b-b5df-d6d308c7d39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:09.204066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1381/2755] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:09.213894 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed40a-834e-49eb-9eca-1f1fee5cbb23 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.214188 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed40a-834e-49eb-9eca-1f1fee5cbb23 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.214463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed40a-834e-49eb-9eca-1f1fee5cbb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.235148 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-50fed40a-834e-49eb-9eca-1f1fee5cbb23 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:09.236475 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-50fed40a-834e-49eb-9eca-1f1fee5cbb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:09.245596 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1375/2756] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:09.250120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bc95-7dd4-4e6b-b5df-d6d308c7d39d None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.260672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bc95-7dd4-4e6b-b5df-d6d308c7d39d None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.265485 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.266102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.266387 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.266663 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.267413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:09.267725 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.269376 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.282019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1382/2757] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:09.286445 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fed40a-834e-49eb-9eca-1f1fee5cbb23 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.296259 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fed40a-834e-49eb-9eca-1f1fee5cbb23 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.300881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.301494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.301778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.302069 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.302721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.304676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.331694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1376/2758] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:09 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:09.337130 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.347832 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26819a-fe98-4941-aefa-8e0d1812d125 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.405481 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.406017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.406300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.406578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.407234 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.409254 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.432887 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1383/2759] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:09 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:25:09.436993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.447788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff993e-ab90-4df0-bfb9-10c1defdb49b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.452654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.453386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.453694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.453967 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.454700 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.456566 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.467750 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1377/2760] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:09.472053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.481910 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f742b3-1ce4-40ce-89f3-bf064beff71e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.486874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12026a9e-fc22-4a68-8862-74154f9a2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.487518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026a9e-fc22-4a68-8862-74154f9a2c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.487800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026a9e-fc22-4a68-8862-74154f9a2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.488075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026a9e-fc22-4a68-8862-74154f9a2c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.488770 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12026a9e-fc22-4a68-8862-74154f9a2c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.490577 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12026a9e-fc22-4a68-8862-74154f9a2c66 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.504335 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1384/2761] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:09.508724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.518993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f165a4-a649-4291-861b-8b227f848656 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.524451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.525102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.525384 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.525654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] PATH_INFO: `/v3/projects/0d5f24443d794d8f9f5c3e12580aab17/users/a6092d7bb5924a8f92556a3f818da2f3/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.541331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5f24443d794d8f9f5c3e12580aab17, user_id=a6092d7bb5924a8f92556a3f818da2f3, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.548574 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.563683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1378/2762] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:09 2022] PUT /identity/v3/projects/0d5f24443d794d8f9f5c3e12580aab17/users/a6092d7bb5924a8f92556a3f818da2f3/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:09.574535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4009-b9ae-4dc5-9a11-20058241b2ac None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.574822 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4009-b9ae-4dc5-9a11-20058241b2ac None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.575097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d4009-b9ae-4dc5-9a11-20058241b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.605645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f69d4009-b9ae-4dc5-9a11-20058241b2ac None None] MFA Rules not processed for user `a6092d7bb5924a8f92556a3f818da2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:09.606857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f69d4009-b9ae-4dc5-9a11-20058241b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:09.625740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:09.676454 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1385/2763] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:09.680816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.744968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba067c6-b53c-42e7-bfb6-f69efeb74e7d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.749634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.750244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.750521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.750793 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.751480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.753368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.784462 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1379/2764] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:09 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:09.786825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d4009-b9ae-4dc5-9a11-20058241b2ac None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.797612 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d4009-b9ae-4dc5-9a11-20058241b2ac None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.862190 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.862723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.863003 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.863303 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.863989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.866433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.887195 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1386/2765] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:09 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:09.891512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.901887 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801ed69-e01a-486a-ac74-ff037c3f3107 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.906437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.907052 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.907374 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.907654 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.908344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.909932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.921179 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1380/2766] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:09.925549 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.936625 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612b0f2-f4e9-409a-a7e0-69c91dd1f301 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:09.941562 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:09.942228 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:09.943159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:09.943426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] PATH_INFO: `/v3/projects/bd1f842fd6f341d09ef4fa5cd0f94d60/users/4f69ee8d6d584b09a3ea43bf510594f2/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:09.958405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1f842fd6f341d09ef4fa5cd0f94d60, user_id=4f69ee8d6d584b09a3ea43bf510594f2, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:09.961203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:09.981342 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1387/2767] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:09 2022] PUT /identity/v3/projects/bd1f842fd6f341d09ef4fa5cd0f94d60/users/4f69ee8d6d584b09a3ea43bf510594f2/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:09.985565 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:09.996399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cabf2-0a87-4e3e-ad09-d4a213e40b0d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:10.036917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:10.069190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a06a3-eda3-4685-854c-5df1ecf0edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:10.069190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a06a3-eda3-4685-854c-5df1ecf0edf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:10.069190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a06a3-eda3-4685-854c-5df1ecf0edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:10.069190 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a06a3-eda3-4685-854c-5df1ecf0edf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:10.069600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a06a3-eda3-4685-854c-5df1ecf0edf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:10.070270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a06a3-eda3-4685-854c-5df1ecf0edf6 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:10.080477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1381/2768] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:10.084776 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:10.096649 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dac003-2185-4ff7-a092-9411f8e0c951 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:10.102049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:10.102803 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:10.103177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:10.103559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] PATH_INFO: `/v3/projects/bd1f842fd6f341d09ef4fa5cd0f94d60/users/4f69ee8d6d584b09a3ea43bf510594f2/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:10.105601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1f842fd6f341d09ef4fa5cd0f94d60, user_id=4f69ee8d6d584b09a3ea43bf510594f2, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:10.120738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:10.120738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1388/2769] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:10 2022] PUT /identity/v3/projects/bd1f842fd6f341d09ef4fa5cd0f94d60/users/4f69ee8d6d584b09a3ea43bf510594f2/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:10.135648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:10.135648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:10.135648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:10.163447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] MFA Rules not processed for user `4f69ee8d6d584b09a3ea43bf510594f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:10.164763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:10.243532 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1382/2770] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:10.254670 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:10.256462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:10.331320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69798-8e2c-4755-8c3e-208d255e9e51 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:10.336349 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:10.337054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:10.337381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:10.337700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:10.347599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:10.350726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:10.363231 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1389/2771] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:10.410404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:10.412429 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:10.424669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee723-d1dd-404c-85fc-52f1fa312d7f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:10.428520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe9c06-f770-4c40-a138-48a79361a25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:10.429140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe9c06-f770-4c40-a138-48a79361a25b service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:10.429454 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe9c06-f770-4c40-a138-48a79361a25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:10.429732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe9c06-f770-4c40-a138-48a79361a25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:10.491085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe9c06-f770-4c40-a138-48a79361a25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:10.492668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe9c06-f770-4c40-a138-48a79361a25b service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:10.502603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1383/2772] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:11.461424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:11.462847 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:11.481618 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:11.529802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1b00c-7059-4996-8aa3-c42a8ca7a7a6 service cinder] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:11.534885 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:11.535582 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:11.535864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:11.536140 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] PATH_INFO: `/v3/users/7688479791504f33ad77c5310c37ac99` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:11.538036 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7688479791504f33ad77c5310c37ac99)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:11.540037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:11.588017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7688479791504f33ad77c5310c37ac99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:11.588678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7688479791504f33ad77c5310c37ac99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:11.589281 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7688479791504f33ad77c5310c37ac99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:11.601636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7688479791504f33ad77c5310c37ac99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:11.608569 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7688479791504f33ad77c5310c37ac99'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:11.622766 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1390/2773] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:11 2022] DELETE /identity/v3/users/7688479791504f33ad77c5310c37ac99 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:11.627325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:11.627844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:11.627952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:11.647483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:11.648733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:11.710248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:11.720044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1384/2774] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:11.730487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:11.732177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:11.793440 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af04a05-2855-4264-99b2-05ceff56f056 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:11.797326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:11.797947 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:11.798230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:11.798505 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:11.808034 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:11.809423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:11.819814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1391/2775] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:12.132923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:12.134313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:12.148325 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070191ab-95a6-4a5f-a302-b682866970e5 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:12.157079 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:12.157737 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:12.158014 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:12.158290 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] PATH_INFO: `/v3/projects/f2416afdddaf4b93b036d59d3fbb9010` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:12.159521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2416afdddaf4b93b036d59d3fbb9010)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:12.161536 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:12.215534 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2416afdddaf4b93b036d59d3fbb9010', 'request_id': 'req-f736a272-ed3d-46e0-86a2-a746d7533e35'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.223519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2416afdddaf4b93b036d59d3fbb9010', 'request_id': 'req-f736a272-ed3d-46e0-86a2-a746d7533e35'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.230327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2416afdddaf4b93b036d59d3fbb9010', 'request_id': 'req-f736a272-ed3d-46e0-86a2-a746d7533e35'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.242828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] The token cache is being invalidate because project f2416afdddaf4b93b036d59d3fbb9010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:12.243106 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.243818 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.245377 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1385/2776] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:12 2022] DELETE /identity/v3/projects/f2416afdddaf4b93b036d59d3fbb9010 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:12.249813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:12.259806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6396a-db0e-473f-90bd-17940cff5362 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:12.294437 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:12.321253 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:12.321850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:12.322180 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:12.322412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] PATH_INFO: `/v3/users/19cc4de69361454f825865c4e88db1df` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:12.323955 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19cc4de69361454f825865c4e88db1df)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:12.325760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:12.381518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19cc4de69361454f825865c4e88db1df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.382187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19cc4de69361454f825865c4e88db1df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.382801 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19cc4de69361454f825865c4e88db1df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.396013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19cc4de69361454f825865c4e88db1df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.407176 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19cc4de69361454f825865c4e88db1df'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.423854 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1392/2777] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:12 2022] DELETE /identity/v3/users/19cc4de69361454f825865c4e88db1df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:25:12.748240 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:12.749777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:12.765845 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a272-ed3d-46e0-86a2-a746d7533e35 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:12.830026 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:12.830601 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:12.830914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:12.831163 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] PATH_INFO: `/v3/projects/42ae577ae4b84158b4b084bd08fd1d6a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:12.832368 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ae577ae4b84158b4b084bd08fd1d6a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:12.834883 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:12.882620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ae577ae4b84158b4b084bd08fd1d6a', 'request_id': 'req-80757965-a773-45cd-8a09-d2d5f6d42dd4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.890335 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ae577ae4b84158b4b084bd08fd1d6a', 'request_id': 'req-80757965-a773-45cd-8a09-d2d5f6d42dd4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.896155 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ae577ae4b84158b4b084bd08fd1d6a', 'request_id': 'req-80757965-a773-45cd-8a09-d2d5f6d42dd4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.907985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] The token cache is being invalidate because project 42ae577ae4b84158b4b084bd08fd1d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:12.908275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.908939 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:12.910715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1386/2778] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:12 2022] DELETE /identity/v3/projects/42ae577ae4b84158b4b084bd08fd1d6a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:12.914710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:12.916236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:12.929419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64683f01-ea2b-47a4-917f-6683432d5c31 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:12.991824 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:12.992469 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:12.992751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:12.993028 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] PATH_INFO: `/v3/users/0dde7fbce55e4b4aba80f2abf5bb1468` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:12.994199 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dde7fbce55e4b4aba80f2abf5bb1468)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:12.996167 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.047772 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dde7fbce55e4b4aba80f2abf5bb1468'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.048450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dde7fbce55e4b4aba80f2abf5bb1468'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.049052 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dde7fbce55e4b4aba80f2abf5bb1468'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.057946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:13.062889 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dde7fbce55e4b4aba80f2abf5bb1468'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.070285 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ed8fcbd3-46c4-4738-950e-e5c593db119a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dde7fbce55e4b4aba80f2abf5bb1468'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.084622 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1393/2779] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:12 2022] DELETE /identity/v3/users/0dde7fbce55e4b4aba80f2abf5bb1468 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:13.364292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.366400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:13.384388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80757965-a773-45cd-8a09-d2d5f6d42dd4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.393164 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:13.446779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.447524 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.447810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.448088 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] PATH_INFO: `/v3/projects/0d3ad24aa1324b23b378670c54cdc1a5` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.449424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3ad24aa1324b23b378670c54cdc1a5)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:13.451444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.499668 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3ad24aa1324b23b378670c54cdc1a5', 'request_id': 'req-52cf319e-9c76-4ae4-9039-f784db96c285'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.507832 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3ad24aa1324b23b378670c54cdc1a5', 'request_id': 'req-52cf319e-9c76-4ae4-9039-f784db96c285'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.513358 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3ad24aa1324b23b378670c54cdc1a5', 'request_id': 'req-52cf319e-9c76-4ae4-9039-f784db96c285'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.525196 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] The token cache is being invalidate because project 0d3ad24aa1324b23b378670c54cdc1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:13.525519 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.526185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-52cf319e-9c76-4ae4-9039-f784db96c285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:13.527869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1387/2780] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:13 2022] DELETE /identity/v3/projects/0d3ad24aa1324b23b378670c54cdc1a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:13.532754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a912-dcb8-4d58-905a-799d7737f967 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.533045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a912-dcb8-4d58-905a-799d7737f967 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.533326 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a912-dcb8-4d58-905a-799d7737f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.553053 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-5c48a912-dcb8-4d58-905a-799d7737f967 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:13.554286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-5c48a912-dcb8-4d58-905a-799d7737f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:13.621300 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1394/2781] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:13.629012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fb720-f4dd-4afb-bd6e-dd938e2f3c96 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.629304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fb720-f4dd-4afb-bd6e-dd938e2f3c96 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.629585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fb720-f4dd-4afb-bd6e-dd938e2f3c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.649788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-c38fb720-f4dd-4afb-bd6e-dd938e2f3c96 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:13.651012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c38fb720-f4dd-4afb-bd6e-dd938e2f3c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:13.658962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1388/2782] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:13.663788 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a912-dcb8-4d58-905a-799d7737f967 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.674518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a912-dcb8-4d58-905a-799d7737f967 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.679399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.680037 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.680323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.680602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.681311 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:13.681626 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:13.683272 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.695907 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1395/2783] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:13.700421 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fb720-f4dd-4afb-bd6e-dd938e2f3c96 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.710261 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fb720-f4dd-4afb-bd6e-dd938e2f3c96 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.716004 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.716634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.716917 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.717192 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.717873 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:13.720110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.749078 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1389/2784] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:13 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:25:13.753883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.764337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581229b8-847f-409d-94ba-0b1307ada8b8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.827792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.828424 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.828710 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.828989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.829685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:13.831682 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.859355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1396/2785] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:13 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:13.863744 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.874693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84da37-c99f-45c9-aa08-5dc40b041ec5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.879612 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.880226 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.881055 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.881320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.882168 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:13.883819 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.895341 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1390/2786] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:13.898952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.909643 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.911419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:13.912526 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8b41-4ad6-4ad5-94cd-d3a1a30f1f8c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.917211 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.917825 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.918112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.918517 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.919221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:13.920874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.927560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3dfc3-6b0f-465a-86d9-1ba8825346a9 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.933285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.933755 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1397/2787] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:13.934142 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.934492 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.934772 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] PATH_INFO: `/v3/users/a6092d7bb5924a8f92556a3f818da2f3` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.935969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6092d7bb5924a8f92556a3f818da2f3)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:13.937794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:13.937975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:13.948159 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6946-839a-443f-ac49-88fbf565796d admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:13.952945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:13.953684 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:13.954134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:13.954523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] PATH_INFO: `/v3/projects/ee07be3270184c0ea7b90a9eada0204b/users/0b8b357457d540a998b304fda70bbbfe/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:13.990778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6092d7bb5924a8f92556a3f818da2f3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.001050 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6092d7bb5924a8f92556a3f818da2f3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.003710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:14.012030 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6092d7bb5924a8f92556a3f818da2f3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.013242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6092d7bb5924a8f92556a3f818da2f3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.013986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-db44c861-aa17-4794-9a0b-ad0a90dc8f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6092d7bb5924a8f92556a3f818da2f3'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.035327 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1391/2788] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:13 2022] DELETE /identity/v3/users/a6092d7bb5924a8f92556a3f818da2f3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:25:14.040835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa857e-acc9-4d35-a300-02dadc11f574 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:14.041124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa857e-acc9-4d35-a300-02dadc11f574 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:14.041399 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa857e-acc9-4d35-a300-02dadc11f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:14.062689 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-dcaa857e-acc9-4d35-a300-02dadc11f574 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:14.063952 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dcaa857e-acc9-4d35-a300-02dadc11f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:14.102737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee07be3270184c0ea7b90a9eada0204b, user_id=0b8b357457d540a998b304fda70bbbfe, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:14.105541 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:14.121049 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1398/2789] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:13 2022] PUT /identity/v3/projects/ee07be3270184c0ea7b90a9eada0204b/users/0b8b357457d540a998b304fda70bbbfe/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:25:14.134124 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1392/2790] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:14.144305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:14.146845 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:14.169777 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:14.190073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:14.190370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:14.190653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:14.211536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b1a8-a86d-4a3d-9f8e-ca5844ab5c0e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:14.215461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:14.215946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:14.216226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:14.216500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:14.219346 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] MFA Rules not processed for user `0b8b357457d540a998b304fda70bbbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:14.220562 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:14.280706 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:14.282442 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:14.288773 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1393/2791] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:14.294718 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1399/2792] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:14.299835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:14.301249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:14.363060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcd31d-1744-4f22-a4b6-d10d94ec3e62 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:14.367214 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:14.367876 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:14.368185 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:14.368461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:14.377865 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:14.379348 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:14.390435 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1394/2793] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:14.868295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:14.870026 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:14.884238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c873f-8e4d-4edd-b559-7faf3ebac633 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:14.890834 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:14.891814 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:14.892203 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:14.892683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] PATH_INFO: `/v3/projects/0d5f24443d794d8f9f5c3e12580aab17` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:14.894066 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5f24443d794d8f9f5c3e12580aab17)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:14.897204 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:14.947132 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5f24443d794d8f9f5c3e12580aab17', 'request_id': 'req-77f038c0-e07f-444e-a79e-efbfd98b9490'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.953377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5f24443d794d8f9f5c3e12580aab17', 'request_id': 'req-77f038c0-e07f-444e-a79e-efbfd98b9490'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.961367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5f24443d794d8f9f5c3e12580aab17', 'request_id': 'req-77f038c0-e07f-444e-a79e-efbfd98b9490'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.972782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] The token cache is being invalidate because project 0d5f24443d794d8f9f5c3e12580aab17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:14.973076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.973726 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:14.975864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1400/2794] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:14 2022] DELETE /identity/v3/projects/0d5f24443d794d8f9f5c3e12580aab17 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:14.979990 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:14.990605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc7ab-c20c-4437-8f24-d17f4372cbbc service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:14.994098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:15.049602 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.050242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.050523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.050798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] PATH_INFO: `/v3/users/4f69ee8d6d584b09a3ea43bf510594f2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.051940 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f69ee8d6d584b09a3ea43bf510594f2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:15.054632 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:15.102965 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f69ee8d6d584b09a3ea43bf510594f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.110627 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f69ee8d6d584b09a3ea43bf510594f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.118212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f69ee8d6d584b09a3ea43bf510594f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.119063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f69ee8d6d584b09a3ea43bf510594f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.119818 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-a17738a6-1d4a-4d63-b5fc-1d66373095af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f69ee8d6d584b09a3ea43bf510594f2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.137398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1395/2795] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:14 2022] DELETE /identity/v3/users/4f69ee8d6d584b09a3ea43bf510594f2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:15.407707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:15.409147 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:15.423384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f038c0-e07f-444e-a79e-efbfd98b9490 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:15.474118 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:15.484700 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.485347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.485827 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.486104 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] PATH_INFO: `/v3/projects/bd1f842fd6f341d09ef4fa5cd0f94d60` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.487410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1f842fd6f341d09ef4fa5cd0f94d60)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:15.489323 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:15.534372 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1f842fd6f341d09ef4fa5cd0f94d60', 'request_id': 'req-03904f7c-4cca-4c05-a33f-a3ef24501a0d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.539891 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1f842fd6f341d09ef4fa5cd0f94d60', 'request_id': 'req-03904f7c-4cca-4c05-a33f-a3ef24501a0d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.546793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1f842fd6f341d09ef4fa5cd0f94d60', 'request_id': 'req-03904f7c-4cca-4c05-a33f-a3ef24501a0d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.558575 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] The token cache is being invalidate because project bd1f842fd6f341d09ef4fa5cd0f94d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:15.558894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.559610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-03904f7c-4cca-4c05-a33f-a3ef24501a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:15.561124 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1401/2796] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:15 2022] DELETE /identity/v3/projects/bd1f842fd6f341d09ef4fa5cd0f94d60 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:15.565993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948dd4-7c77-4451-9fe0-58c778a08d6e None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.566283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948dd4-7c77-4451-9fe0-58c778a08d6e None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.566559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948dd4-7c77-4451-9fe0-58c778a08d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.586735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-11948dd4-7c77-4451-9fe0-58c778a08d6e None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:15.587977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-11948dd4-7c77-4451-9fe0-58c778a08d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:15.646283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1396/2797] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:15.655388 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35203ca-3986-4096-a1ae-63628a521ab1 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.655616 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35203ca-3986-4096-a1ae-63628a521ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.655890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35203ca-3986-4096-a1ae-63628a521ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.675389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d35203ca-3986-4096-a1ae-63628a521ab1 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:15.676742 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d35203ca-3986-4096-a1ae-63628a521ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:15.685389 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1402/2798] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:15.689684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948dd4-7c77-4451-9fe0-58c778a08d6e None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:15.700141 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948dd4-7c77-4451-9fe0-58c778a08d6e None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:15.704651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.705255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.705537 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.705813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.706508 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:15.706811 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:15.708456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:15.720250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1397/2799] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:15.724461 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35203ca-3986-4096-a1ae-63628a521ab1 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:15.733868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35203ca-3986-4096-a1ae-63628a521ab1 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:15.738643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.739368 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.740384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.740965 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.741734 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:15.743687 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:15.777971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1403/2800] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:15 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:15.779114 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:15.789242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ced12-f1ed-4b4f-a78f-776ed0bcca12 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:15.798063 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:15.853696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.854321 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.854605 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.854898 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.855569 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:15.857490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:15.883241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1398/2801] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:15 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:25:15.887330 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:15.897952 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75eed-0536-4a67-811c-a328179abe0c admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:15.902916 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.903554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.903836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.904110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.904802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:15.906592 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:15.918428 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1404/2802] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:25:15.922245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:15.937932 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c59166-1a35-4851-bd56-76c0fed83de8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:15.945409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b79da-8aa5-4951-b8f9-0fe06aabe69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.946039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b79da-8aa5-4951-b8f9-0fe06aabe69c admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.946597 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b79da-8aa5-4951-b8f9-0fe06aabe69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.946882 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b79da-8aa5-4951-b8f9-0fe06aabe69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:15.947648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b79da-8aa5-4951-b8f9-0fe06aabe69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:15.949366 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b79da-8aa5-4951-b8f9-0fe06aabe69c admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:15.969090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1399/2803] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:15.972936 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:15.983235 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9236934-b3c7-4452-8823-cbe1d59df112 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:15.988017 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:15.988672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:15.988954 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:15.989232 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] PATH_INFO: `/v3/projects/db4ed4b4fe174cb48f8651c7d9495660/users/90e582f2d3b0442d93688de0b203de74/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.004470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4ed4b4fe174cb48f8651c7d9495660, user_id=90e582f2d3b0442d93688de0b203de74, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.008299 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.020609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1405/2804] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:15 2022] PUT /identity/v3/projects/db4ed4b4fe174cb48f8651c7d9495660/users/90e582f2d3b0442d93688de0b203de74/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:16.031795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56844c9e-7d60-4b94-a574-77a75fb10215 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.032278 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56844c9e-7d60-4b94-a574-77a75fb10215 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.032433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56844c9e-7d60-4b94-a574-77a75fb10215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.061858 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-56844c9e-7d60-4b94-a574-77a75fb10215 None None] MFA Rules not processed for user `90e582f2d3b0442d93688de0b203de74`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:16.063066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-56844c9e-7d60-4b94-a574-77a75fb10215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:16.127444 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1400/2805] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:16.133013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.195771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723414fb-3f79-4134-a6f4-4ebee948fcd4 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.200757 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.201373 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.201654 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.201928 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.202598 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.204546 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.232445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1406/2806] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:16 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:16.236484 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56844c9e-7d60-4b94-a574-77a75fb10215 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.247653 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56844c9e-7d60-4b94-a574-77a75fb10215 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.302232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.303680 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.303962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.304242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.304901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.306824 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.327846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1401/2807] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:16 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:16.331870 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.337812 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:16.344141 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2a9f6-59fc-467e-a95a-49f24b83682b admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.349697 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.350305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.350588 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.350862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.351591 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.353192 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.363197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1407/2808] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:16.368134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.377903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905b011-b7bd-4ec1-997e-3c81a5e1aa55 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.383340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.384093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.384380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.384657 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] PATH_INFO: `/v3/projects/a4a6666e4feb42608e564b5b8439e9e7/users/5a296198ca014702a607f4dfec1b7fc4/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.393044 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:16.401419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a6666e4feb42608e564b5b8439e9e7, user_id=5a296198ca014702a607f4dfec1b7fc4, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.404314 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.416722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1402/2809] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:16 2022] PUT /identity/v3/projects/a4a6666e4feb42608e564b5b8439e9e7/users/5a296198ca014702a607f4dfec1b7fc4/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:16.420830 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.431333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68881f-3360-4b3e-bf48-54d708aea291 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.487043 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49702f-38fe-4d11-b2a4-f7d6bfdaf20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.487698 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49702f-38fe-4d11-b2a4-f7d6bfdaf20b admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.487943 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49702f-38fe-4d11-b2a4-f7d6bfdaf20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.488249 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49702f-38fe-4d11-b2a4-f7d6bfdaf20b admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.489100 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49702f-38fe-4d11-b2a4-f7d6bfdaf20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.492426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49702f-38fe-4d11-b2a4-f7d6bfdaf20b admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.502314 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1408/2810] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:16.507075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.517648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d313dfd-a0e2-45fd-bae8-b8a454b2ebb0 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.522585 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.523242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.523554 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.523833 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] PATH_INFO: `/v3/projects/a4a6666e4feb42608e564b5b8439e9e7/users/5a296198ca014702a607f4dfec1b7fc4/roles/bd9f5a9a33c44f42b039e5fe54e8230a` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.525797 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a6666e4feb42608e564b5b8439e9e7, user_id=5a296198ca014702a607f4dfec1b7fc4, role_id=bd9f5a9a33c44f42b039e5fe54e8230a)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.528670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.538938 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1403/2811] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:16 2022] PUT /identity/v3/projects/a4a6666e4feb42608e564b5b8439e9e7/users/5a296198ca014702a607f4dfec1b7fc4/roles/bd9f5a9a33c44f42b039e5fe54e8230a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:16.549837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1b7c-0cb5-4b66-ba0b-abcd0ec66e21 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.550128 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1b7c-0cb5-4b66-ba0b-abcd0ec66e21 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.550478 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1b7c-0cb5-4b66-ba0b-abcd0ec66e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.578652 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-a33a1b7c-0cb5-4b66-ba0b-abcd0ec66e21 None None] MFA Rules not processed for user `5a296198ca014702a607f4dfec1b7fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:16.579915 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a33a1b7c-0cb5-4b66-ba0b-abcd0ec66e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:16.647138 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1409/2812] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:16.657766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.659560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:16.720015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b5eb4-4b2e-48f0-968f-2a877e8241d5 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.723594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.724708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.725453 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.725731 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.735006 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.736470 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.746202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1404/2813] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:16.821033 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a1b7c-0cb5-4b66-ba0b-abcd0ec66e21 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:16.830754 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a1b7c-0cb5-4b66-ba0b-abcd0ec66e21 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:16.834295 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e1b9f-b7f7-45bd-b69b-e5a7fbf15e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:16.834894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1b9f-b7f7-45bd-b69b-e5a7fbf15e12 service cinder] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:16.835177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1b9f-b7f7-45bd-b69b-e5a7fbf15e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:16.835495 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1b9f-b7f7-45bd-b69b-e5a7fbf15e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:16.892857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e1b9f-b7f7-45bd-b69b-e5a7fbf15e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:16.894292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e1b9f-b7f7-45bd-b69b-e5a7fbf15e12 service cinder] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:16.904105 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1410/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:17.000208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:17.001711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.088241 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25312a-6500-49b4-b255-5087c99a6349 service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:17.094672 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:17.095386 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.095709 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.096024 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] PATH_INFO: `/v3/users/0b8b357457d540a998b304fda70bbbfe` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.098242 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8b357457d540a998b304fda70bbbfe)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:17.100156 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:17.159514 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8b357457d540a998b304fda70bbbfe'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.168345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8b357457d540a998b304fda70bbbfe'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.179804 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8b357457d540a998b304fda70bbbfe'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.181557 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8b357457d540a998b304fda70bbbfe'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.182722 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8b357457d540a998b304fda70bbbfe'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.201791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:17.211356 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1405/2815] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:16 2022] DELETE /identity/v3/users/0b8b357457d540a998b304fda70bbbfe => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:17.214320 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.214721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.214861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.238583 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:17.240419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.245923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:17.310932 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1411/2816] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:17.321437 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:17.322903 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.383546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227a3e-374a-48d6-b848-78efa96cf91e admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:17.387170 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:17.387822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.388100 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.388371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.398676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:17.400258 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:17.410249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1406/2817] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:17.429873 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:17.431386 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.444584 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0899bfa-9495-4e8f-acc2-3b77aae4d905 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:17.448415 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8e3ca-936d-4484-9b90-e64d6501665d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:17.449029 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e3ca-936d-4484-9b90-e64d6501665d service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.449305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e3ca-936d-4484-9b90-e64d6501665d service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.449571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e3ca-936d-4484-9b90-e64d6501665d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.451317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-40f8e3ca-936d-4484-9b90-e64d6501665d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.462692 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8e3ca-936d-4484-9b90-e64d6501665d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:17.464308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8e3ca-936d-4484-9b90-e64d6501665d service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:17.473313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1412/2818] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:17.694521 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:17.695985 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.710548 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b964-30c4-49f2-b85b-32b34466f05d service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:17.715255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:17.715914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.716193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.716464 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] PATH_INFO: `/v3/projects/ee07be3270184c0ea7b90a9eada0204b` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.717619 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee07be3270184c0ea7b90a9eada0204b)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:17.719835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:17.782203 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee07be3270184c0ea7b90a9eada0204b', 'request_id': 'req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.790739 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee07be3270184c0ea7b90a9eada0204b', 'request_id': 'req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.796923 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee07be3270184c0ea7b90a9eada0204b', 'request_id': 'req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.809670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] The token cache is being invalidate because project ee07be3270184c0ea7b90a9eada0204b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:17.809963 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.810635 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-0ec51f56-67f6-4905-a4d0-c7b2f64d1592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:17.812280 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1407/2819] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:17 2022] DELETE /identity/v3/projects/ee07be3270184c0ea7b90a9eada0204b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:25:17.817015 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993d320-2541-438f-a8bb-561726cc31ff None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.817410 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993d320-2541-438f-a8bb-561726cc31ff None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.817578 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993d320-2541-438f-a8bb-561726cc31ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.837648 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-7993d320-2541-438f-a8bb-561726cc31ff None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:17.838874 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-7993d320-2541-438f-a8bb-561726cc31ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.901963 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1413/2820] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:17.909828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597b7a-1d70-440f-9e4a-7ab4a5753de2 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.910138 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597b7a-1d70-440f-9e4a-7ab4a5753de2 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.910441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597b7a-1d70-440f-9e4a-7ab4a5753de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.933365 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1f597b7a-1d70-440f-9e4a-7ab4a5753de2 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:17.934561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1f597b7a-1d70-440f-9e4a-7ab4a5753de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:17.942501 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1408/2821] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:17.947544 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993d320-2541-438f-a8bb-561726cc31ff None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:17.957298 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993d320-2541-438f-a8bb-561726cc31ff None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:17.961923 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:17.962523 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.962802 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.963074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.963809 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:17.964097 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:17.965685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:17.977484 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1414/2822] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:17.981710 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597b7a-1d70-440f-9e4a-7ab4a5753de2 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:17.991469 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597b7a-1d70-440f-9e4a-7ab4a5753de2 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:17.996140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:17.996743 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:17.997025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:17.997300 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:17.997968 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:18.000041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:18.028378 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1409/2823] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:17 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:18.032480 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:18.042418 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593085-fed7-43f8-a94b-386ce8c3c290 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:18.098154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:18.098769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:18.099074 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:18.099940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:18.100731 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:18.102666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:18.122713 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1415/2824] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:18 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:18.126989 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:18.137922 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e535e1-16f4-41d1-8596-278a1aef89a8 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:18.142494 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:18.143098 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:18.143423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:18.143701 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:18.144391 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:18.146560 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:18.156311 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1410/2825] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:18.160123 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:18.169946 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1f2a0-f336-4623-98c6-8d1dcf0a43c6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:18.174492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb843de-4b92-4958-9ab3-a27ced97a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:18.175087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb843de-4b92-4958-9ab3-a27ced97a704 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:18.175404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb843de-4b92-4958-9ab3-a27ced97a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:18.175683 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb843de-4b92-4958-9ab3-a27ced97a704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:18.176365 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb843de-4b92-4958-9ab3-a27ced97a704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:18.177992 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb843de-4b92-4958-9ab3-a27ced97a704 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:18.188343 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1416/2826] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:18.192217 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:18.202498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2e19-7f29-4227-8134-fbe0d9e5b0d1 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:18.207090 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:18.207768 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:18.208051 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:18.208331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] PATH_INFO: `/v3/projects/3896aef3a9a94417afa9d984328c82ad/users/de2dc96ffbca48809b46a718cc9d4d5a/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:18.223648 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3896aef3a9a94417afa9d984328c82ad, user_id=de2dc96ffbca48809b46a718cc9d4d5a, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:18.226477 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:18.238914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1411/2827] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:18 2022] PUT /identity/v3/projects/3896aef3a9a94417afa9d984328c82ad/users/de2dc96ffbca48809b46a718cc9d4d5a/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:18.249358 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:18.249858 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:18.249971 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:18.258656 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:18.279721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] MFA Rules not processed for user `de2dc96ffbca48809b46a718cc9d4d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:18.280877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:18.347881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1417/2828] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:18.360133 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:18.363461 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:18.383706 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:18.429790 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b13e-3ac6-4392-a310-8b2e59528785 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:18.433573 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:18.434194 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:18.434893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:18.434893 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:18.444695 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:18.445886 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:18.456779 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1412/2829] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:19.436864 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:19.439857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:19.545246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb03d9-1ab1-475f-a233-34b1280f92cb None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:19.551407 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbb9f6-28bf-4397-a05b-1586c41ab898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:19.553385 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbb9f6-28bf-4397-a05b-1586c41ab898 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:19.554004 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbb9f6-28bf-4397-a05b-1586c41ab898 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:19.554436 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbb9f6-28bf-4397-a05b-1586c41ab898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:19.560291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-44dbb9f6-28bf-4397-a05b-1586c41ab898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:19.581538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbb9f6-28bf-4397-a05b-1586c41ab898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:19.583173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbb9f6-28bf-4397-a05b-1586c41ab898 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:19.596146 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1418/2830] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:21.356716 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:21.359027 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:21.456925 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940c42-5dd3-4e05-8d0a-5bab8b9f8c4c service cinder] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:21.463425 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:21.464245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:21.465455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:21.465960 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] PATH_INFO: `/v3/users/90e582f2d3b0442d93688de0b203de74` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:21.469162 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e582f2d3b0442d93688de0b203de74)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:21.473140 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:21.546888 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e582f2d3b0442d93688de0b203de74'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:21.571795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e582f2d3b0442d93688de0b203de74'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:21.581759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e582f2d3b0442d93688de0b203de74'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:21.582678 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e582f2d3b0442d93688de0b203de74'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:21.583867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e582f2d3b0442d93688de0b203de74'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:21.603649 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1413/2831] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:21 2022] DELETE /identity/v3/users/90e582f2d3b0442d93688de0b203de74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:21.608789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:21.609380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:21.609380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:21.634110 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:21.635800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:21.746383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1419/2832] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:21.756512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:21.758245 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:21.832329 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:21.876158 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917770d-f1e2-4b14-a2b8-5ae65a4b28a7 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:21.883102 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:21.884035 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:21.884480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:21.885380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:21.908517 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:21.910249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:21.937595 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1414/2833] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:22.269260 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:22.274620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:22.303501 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd31b0-9525-4f86-9c9b-ed0145f31168 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:22.310064 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:22.311076 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:22.311574 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:22.311729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] PATH_INFO: `/v3/projects/db4ed4b4fe174cb48f8651c7d9495660` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:22.314880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4ed4b4fe174cb48f8651c7d9495660)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:22.318666 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:22.340792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=100 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:22.409487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4ed4b4fe174cb48f8651c7d9495660', 'request_id': 'req-ea3ea546-7756-4412-a001-52a31a3732d9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.417215 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4ed4b4fe174cb48f8651c7d9495660', 'request_id': 'req-ea3ea546-7756-4412-a001-52a31a3732d9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.435782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4ed4b4fe174cb48f8651c7d9495660', 'request_id': 'req-ea3ea546-7756-4412-a001-52a31a3732d9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.461337 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] The token cache is being invalidate because project db4ed4b4fe174cb48f8651c7d9495660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:22.461850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.462680 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.465518 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1420/2834] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:22 2022] DELETE /identity/v3/projects/db4ed4b4fe174cb48f8651c7d9495660 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:22.470810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:22.485835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c8cff-6ae3-444f-8258-b30032df2b60 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:22.643561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:22.645340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:22.646687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:22.647774 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] PATH_INFO: `/v3/users/5a296198ca014702a607f4dfec1b7fc4` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:22.659153 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a296198ca014702a607f4dfec1b7fc4)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:22.661583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:22.763288 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a296198ca014702a607f4dfec1b7fc4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.776446 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a296198ca014702a607f4dfec1b7fc4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.792671 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a296198ca014702a607f4dfec1b7fc4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.793908 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a296198ca014702a607f4dfec1b7fc4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.794732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1e7cac37-dbaf-4484-a0aa-d5a340da30e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a296198ca014702a607f4dfec1b7fc4'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:22.821783 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1415/2835] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:22 2022] DELETE /identity/v3/users/5a296198ca014702a607f4dfec1b7fc4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:23.417117 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:23.418743 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:23.434282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea546-7756-4412-a001-52a31a3732d9 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:23.496134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:23.496774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.497051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.497328 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] PATH_INFO: `/v3/projects/a4a6666e4feb42608e564b5b8439e9e7` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.498475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a6666e4feb42608e564b5b8439e9e7)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:23.500446 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:23.550071 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a6666e4feb42608e564b5b8439e9e7', 'request_id': 'req-e5f4e953-d633-4ce5-b65a-a075730e8b8f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:23.556238 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a6666e4feb42608e564b5b8439e9e7', 'request_id': 'req-e5f4e953-d633-4ce5-b65a-a075730e8b8f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:23.565009 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a6666e4feb42608e564b5b8439e9e7', 'request_id': 'req-e5f4e953-d633-4ce5-b65a-a075730e8b8f'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:23.578524 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] The token cache is being invalidate because project a4a6666e4feb42608e564b5b8439e9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:23.578813 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:23.579483 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-e5f4e953-d633-4ce5-b65a-a075730e8b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:23.580989 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1421/2836] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:23 2022] DELETE /identity/v3/projects/a4a6666e4feb42608e564b5b8439e9e7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:23.585857 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119429-711d-46e3-9c2a-133fac173f5d None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.586343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119429-711d-46e3-9c2a-133fac173f5d None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.586343 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119429-711d-46e3-9c2a-133fac173f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.606785 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-87119429-711d-46e3-9c2a-133fac173f5d None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:23.608009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-87119429-711d-46e3-9c2a-133fac173f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:23.671066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1416/2837] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:23.679197 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65259-2e44-41b2-a8d1-462a19acacfe None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.679534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65259-2e44-41b2-a8d1-462a19acacfe None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.679806 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65259-2e44-41b2-a8d1-462a19acacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.700054 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-93d65259-2e44-41b2-a8d1-462a19acacfe None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:23.701246 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-93d65259-2e44-41b2-a8d1-462a19acacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:23.709837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1422/2838] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:23.714093 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119429-711d-46e3-9c2a-133fac173f5d None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:23.719285 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:23.725758 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119429-711d-46e3-9c2a-133fac173f5d None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:23.731651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:23.732269 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.732553 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.732840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.733520 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:23.733822 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:23.735471 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:23.751962 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1417/2839] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:23.752901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65259-2e44-41b2-a8d1-462a19acacfe None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:23.763740 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65259-2e44-41b2-a8d1-462a19acacfe None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:23.768460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:23.769075 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.769350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.769620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.770771 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:23.772384 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:23.805332 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1423/2840] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:23 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:23.810058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:23.821420 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea24b45-25bb-4766-8598-290ad8ec5dd2 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:23.855007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:23.856863 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:23.863960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:23.915697 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:23.916326 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.916614 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.916866 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] PATH_INFO: `/v3/users` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.917535 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:23.920060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:23.953878 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1418/2841] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:23 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:23.955001 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:23.958307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff677e-cb49-49cc-8737-87a5dd9f5902 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:23.965007 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:23.965467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50010b3e-6935-4e7e-a6e5-8953fd2f29bd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:23.965712 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.966012 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.966347 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] PATH_INFO: `/v3/users/de2dc96ffbca48809b46a718cc9d4d5a` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.967553 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2dc96ffbca48809b46a718cc9d4d5a)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:23.970545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:23.970684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:23.971304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:23.971599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:23.971874 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:23.972692 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:23.974323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:23.985572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1419/2842] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:23.990334 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:24.001946 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b540163-7373-4330-827e-ff522e302d78 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:24.008586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:24.009299 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:24.009616 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:24.009934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:24.010745 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:24.012603 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:24.025813 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1420/2843] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:25:24.029472 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2dc96ffbca48809b46a718cc9d4d5a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.029999 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:24.030866 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2dc96ffbca48809b46a718cc9d4d5a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.031711 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2dc96ffbca48809b46a718cc9d4d5a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.041778 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154074ce-094c-4cd7-990a-7d928728c312 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:24.045789 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2dc96ffbca48809b46a718cc9d4d5a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.047320 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af40b5-9505-4074-b9d2-e9d04ca7a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:24.047993 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af40b5-9505-4074-b9d2-e9d04ca7a446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:24.048275 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af40b5-9505-4074-b9d2-e9d04ca7a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:24.048551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af40b5-9505-4074-b9d2-e9d04ca7a446 admin admin] PATH_INFO: `/v3/projects/3ce6c4a22e6747d5b3bde4386f143194/users/9057e417a53842c2bcb2452961c4353d/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:24.054112 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-27d96fca-13ed-4762-95e7-9a3c0e19502a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2dc96ffbca48809b46a718cc9d4d5a'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.065361 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af40b5-9505-4074-b9d2-e9d04ca7a446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce6c4a22e6747d5b3bde4386f143194, user_id=9057e417a53842c2bcb2452961c4353d, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:24.068791 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af40b5-9505-4074-b9d2-e9d04ca7a446 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:24.069685 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1424/2844] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:23 2022] DELETE /identity/v3/users/de2dc96ffbca48809b46a718cc9d4d5a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:24.074011 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:24.074412 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:24.074774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:24.089186 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1421/2845] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:24 2022] PUT /identity/v3/projects/3ce6c4a22e6747d5b3bde4386f143194/users/9057e417a53842c2bcb2452961c4353d/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:25:24.098466 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:24.099535 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:24.101007 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70584779-550b-450e-928b-238e2abca4cf None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:24.101430 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70584779-550b-450e-928b-238e2abca4cf None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:24.101810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70584779-550b-450e-928b-238e2abca4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:24.131693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-70584779-550b-450e-928b-238e2abca4cf None None] MFA Rules not processed for user `9057e417a53842c2bcb2452961c4353d`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:24.132912 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-70584779-550b-450e-928b-238e2abca4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:24.162057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1425/2846] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:25:24.171426 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:24.172767 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:24.201108 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1422/2847] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:24.202982 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:24.212855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70584779-550b-450e-928b-238e2abca4cf None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:24.214472 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-70584779-550b-450e-928b-238e2abca4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:24.236120 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a90a-698d-493e-bbae-4e184a743989 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:24.239781 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:24.240396 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:24.240678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:24.240950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:24.241842 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:24.250705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:24.252173 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:24.262341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1426/2848] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:25:24.275992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70584779-550b-450e-928b-238e2abca4cf None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:24.279683 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a2167-588e-462f-96f5-a0d06b3de2b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:24.280298 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a2167-588e-462f-96f5-a0d06b3de2b4 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:24.280579 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a2167-588e-462f-96f5-a0d06b3de2b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:24.280855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a2167-588e-462f-96f5-a0d06b3de2b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:24.289736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a2167-588e-462f-96f5-a0d06b3de2b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:24.291362 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a2167-588e-462f-96f5-a0d06b3de2b4 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:24.301085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1423/2849] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:25:24.572705 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:24.574381 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:24.590750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8a55-2fa5-4336-8406-8b36790caaef service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:24.596795 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:24.597557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:24.597876 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:24.598264 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] PATH_INFO: `/v3/projects/3896aef3a9a94417afa9d984328c82ad` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:24.600030 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3896aef3a9a94417afa9d984328c82ad)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:24.601961 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:24.654031 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3896aef3a9a94417afa9d984328c82ad', 'request_id': 'req-a1609b6b-17d2-4bc9-b813-387ab22539a8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.660912 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3896aef3a9a94417afa9d984328c82ad', 'request_id': 'req-a1609b6b-17d2-4bc9-b813-387ab22539a8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.669643 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3896aef3a9a94417afa9d984328c82ad', 'request_id': 'req-a1609b6b-17d2-4bc9-b813-387ab22539a8'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.685507 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] The token cache is being invalidate because project 3896aef3a9a94417afa9d984328c82ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:24.685838 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.686678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:24.688380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1427/2850] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:24 2022] DELETE /identity/v3/projects/3896aef3a9a94417afa9d984328c82ad => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:27.588340 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:27.589172 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:27.589669 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:27.610369 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] MFA Rules not processed for user `a3d53b503346487fa4d707623ab4cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:27.611759 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:27.672410 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1424/2851] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 04:25:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:27.722609 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:27.725113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:27.797676 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609b6b-17d2-4bc9-b813-387ab22539a8 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:27.802497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11cd9091a4654f5eb689e23061b6e52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:27.803093 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:27.803413 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:27.803690 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:27.811741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:27.813333 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:27.821664 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1428/2852] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 04:25:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 04:25:31.855307 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:31.856852 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:31.943473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c185cbb-9691-4784-af8b-19d9740e5a7f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:31.947193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:31.947770 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:31.948121 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:31.948467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:31.950490 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:32.018795 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:32.020844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:32.031606 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1425/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:35.780226 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:35.781794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:35.826775 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:35.849571 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c398778-6a3d-4e66-a0ec-9e8edcc14cce service swift] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:35.854094 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:35.854730 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:35.855013 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:35.855307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] PATH_INFO: `/v3/users/e1d18730d46546daac82fb20fbb07a4c` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:35.856471 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d18730d46546daac82fb20fbb07a4c)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:35.858404 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:35.904291 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d18730d46546daac82fb20fbb07a4c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:35.904933 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d18730d46546daac82fb20fbb07a4c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:35.905522 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d18730d46546daac82fb20fbb07a4c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:35.916913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d18730d46546daac82fb20fbb07a4c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:35.923761 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d18730d46546daac82fb20fbb07a4c'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:35.939635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1429/2854] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:35 2022] DELETE /identity/v3/users/e1d18730d46546daac82fb20fbb07a4c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:36.122304 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:36.133551 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4de4a6-9cdb-49b2-8db0-d5e048789803 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:36.153147 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=100 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:36.194076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:36.194742 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:36.195019 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:36.195313 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] PATH_INFO: `/v3/projects/661af733e7b4422fb08c81e67978cf5c` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:36.196456 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=661af733e7b4422fb08c81e67978cf5c)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:36.198380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:36.242937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661af733e7b4422fb08c81e67978cf5c', 'request_id': 'req-8f3f3a7d-f689-43a7-b124-813b3627f9fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.250151 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661af733e7b4422fb08c81e67978cf5c', 'request_id': 'req-8f3f3a7d-f689-43a7-b124-813b3627f9fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.256828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661af733e7b4422fb08c81e67978cf5c', 'request_id': 'req-8f3f3a7d-f689-43a7-b124-813b3627f9fc'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.268539 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] The token cache is being invalidate because project 661af733e7b4422fb08c81e67978cf5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:36.268831 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.269473 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.271721 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1426/2855] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:36 2022] DELETE /identity/v3/projects/661af733e7b4422fb08c81e67978cf5c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:36.275823 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:36.277222 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:36.290608 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd871-9309-4290-8c9c-b62942dc0ba2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:36.346450 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:36.347006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:36.347317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:36.347599 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] PATH_INFO: `/v3/users/f6bb071587ec48e0852f0ba51b2b4de6` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:36.348914 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bb071587ec48e0852f0ba51b2b4de6)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:36.350909 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:36.398445 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bb071587ec48e0852f0ba51b2b4de6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.399092 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bb071587ec48e0852f0ba51b2b4de6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.399721 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bb071587ec48e0852f0ba51b2b4de6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.409672 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:36.412168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bb071587ec48e0852f0ba51b2b4de6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.419665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bb071587ec48e0852f0ba51b2b4de6'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.431949 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1430/2856] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:36 2022] DELETE /identity/v3/users/f6bb071587ec48e0852f0ba51b2b4de6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:36.608613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:36.610066 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:36.623928 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3a7d-f689-43a7-b124-813b3627f9fc admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:36.686071 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:36.686712 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:36.687012 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:36.687294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] PATH_INFO: `/v3/projects/6ec9208e2e184d01a9b88d6208373dae` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:36.688455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec9208e2e184d01a9b88d6208373dae)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:36.690449 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:36.737914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec9208e2e184d01a9b88d6208373dae', 'request_id': 'req-347866dd-cd1a-4116-9355-b2fb1d05a029'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.741451 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:36.747404 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec9208e2e184d01a9b88d6208373dae', 'request_id': 'req-347866dd-cd1a-4116-9355-b2fb1d05a029'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.754016 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec9208e2e184d01a9b88d6208373dae', 'request_id': 'req-347866dd-cd1a-4116-9355-b2fb1d05a029'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.765964 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] The token cache is being invalidate because project 6ec9208e2e184d01a9b88d6208373dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:36.766250 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.766895 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-347866dd-cd1a-4116-9355-b2fb1d05a029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:36.768480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1427/2857] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:36 2022] DELETE /identity/v3/projects/6ec9208e2e184d01a9b88d6208373dae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:38.949877 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:38.951367 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:38.964060 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de130ae-2d2a-4f59-ab48-3efee05f3935 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:39.025950 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:39.026614 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.026893 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.027168 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] PATH_INFO: `/v3/users/9057e417a53842c2bcb2452961c4353d` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.028357 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9057e417a53842c2bcb2452961c4353d)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:39.030279 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:39.075881 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9057e417a53842c2bcb2452961c4353d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.076534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9057e417a53842c2bcb2452961c4353d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.077150 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9057e417a53842c2bcb2452961c4353d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.089645 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9057e417a53842c2bcb2452961c4353d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.096704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9057e417a53842c2bcb2452961c4353d'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.109154 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1431/2858] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:38 2022] DELETE /identity/v3/users/9057e417a53842c2bcb2452961c4353d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:39.113735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.114248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.114400 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.133840 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:39.135054 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:39.193083 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1428/2859] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:39.202665 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:39.204119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:39.261164 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287131-07c5-4400-8e7d-022e9112c578 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:39.264871 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feac6d-0d69-4016-abb3-4f8e3277714f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:39.265536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feac6d-0d69-4016-abb3-4f8e3277714f service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.265815 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feac6d-0d69-4016-abb3-4f8e3277714f service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.266087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feac6d-0d69-4016-abb3-4f8e3277714f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.276166 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feac6d-0d69-4016-abb3-4f8e3277714f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:39.277527 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feac6d-0d69-4016-abb3-4f8e3277714f service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:39.282377 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:39.288200 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1432/2860] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:39.560715 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:39.562238 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:39.575232 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7ec9-5a41-4806-8a0d-4712cc8fc5d6 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:39.580282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:39.580973 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.581306 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.581480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] PATH_INFO: `/v3/projects/3ce6c4a22e6747d5b3bde4386f143194` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.582979 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce6c4a22e6747d5b3bde4386f143194)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:39.584950 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:39.633613 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce6c4a22e6747d5b3bde4386f143194', 'request_id': 'req-1df57bf0-480a-4890-b397-5b7ed75bb29b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.640986 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce6c4a22e6747d5b3bde4386f143194', 'request_id': 'req-1df57bf0-480a-4890-b397-5b7ed75bb29b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.646455 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce6c4a22e6747d5b3bde4386f143194', 'request_id': 'req-1df57bf0-480a-4890-b397-5b7ed75bb29b'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.657312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] The token cache is being invalidate because project 3ce6c4a22e6747d5b3bde4386f143194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:39.657594 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.658217 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-1df57bf0-480a-4890-b397-5b7ed75bb29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:39.659777 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1429/2861] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:39 2022] DELETE /identity/v3/projects/3ce6c4a22e6747d5b3bde4386f143194 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:39.665265 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83200f-e1da-4d2b-8a5d-46f3a6974bbe None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.665557 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83200f-e1da-4d2b-8a5d-46f3a6974bbe None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.665837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83200f-e1da-4d2b-8a5d-46f3a6974bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.685462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-aa83200f-e1da-4d2b-8a5d-46f3a6974bbe None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:39.686669 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-aa83200f-e1da-4d2b-8a5d-46f3a6974bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:39.746462 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1433/2862] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:39.755905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bba2d-745a-49b8-9a93-75fa4ff7c6aa None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.756200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bba2d-745a-49b8-9a93-75fa4ff7c6aa None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.756483 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bba2d-745a-49b8-9a93-75fa4ff7c6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.775868 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-fe3bba2d-745a-49b8-9a93-75fa4ff7c6aa None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:39.777073 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-fe3bba2d-745a-49b8-9a93-75fa4ff7c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:39.784867 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1430/2863] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:39.789024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83200f-e1da-4d2b-8a5d-46f3a6974bbe None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:39.798636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83200f-e1da-4d2b-8a5d-46f3a6974bbe None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:39.803793 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:39.804339 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.804621 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.804902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.805593 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:39.805899 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:39.807515 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:39.819563 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1434/2864] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:39.823673 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bba2d-745a-49b8-9a93-75fa4ff7c6aa None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:39.832875 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bba2d-745a-49b8-9a93-75fa4ff7c6aa None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:39.837468 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:39.838068 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.838352 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.838629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.839323 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:39.841233 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:39.869988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1431/2865] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:39 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:39.874121 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:39.884006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c579c5d-f531-4561-80f1-d4051667d3c6 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:39.939603 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:39.940206 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.940487 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.940760 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.941423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:39.944061 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:39.964880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1435/2866] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:39 2022] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:39.969411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:39.980428 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150cd93-497f-4bce-83cd-2c293c616ca4 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:39.985032 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:39.985642 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:39.985926 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:39.986205 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:39.986901 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:39.989176 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:39.999798 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1432/2867] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:40.003723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:40.013883 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c11ec-5d92-406e-bd6e-09591253122e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:40.018403 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cbfc3-79e8-4468-80ab-f98f52e2ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:40.019006 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cbfc3-79e8-4468-80ab-f98f52e2ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.019324 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cbfc3-79e8-4468-80ab-f98f52e2ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.019640 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cbfc3-79e8-4468-80ab-f98f52e2ae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.020301 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cbfc3-79e8-4468-80ab-f98f52e2ae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:40.021922 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cbfc3-79e8-4468-80ab-f98f52e2ae13 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:40.032338 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1436/2868] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:40.036934 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:40.046797 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1973a1-2b94-4a1f-805c-f46f32ee5130 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:40.052042 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:40.052693 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.052975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.053248 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] PATH_INFO: `/v3/projects/317feca5e0884101a1eb10c84c533971/users/ab47be01ba8e4066b1b0e6ebf0532c16/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.068331 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=317feca5e0884101a1eb10c84c533971, user_id=ab47be01ba8e4066b1b0e6ebf0532c16, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:40.070992 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:40.079409 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:40.084835 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1433/2869] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:40 2022] PUT /identity/v3/projects/317feca5e0884101a1eb10c84c533971/users/ab47be01ba8e4066b1b0e6ebf0532c16/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:25:40.095610 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d4e15-45bc-44d7-b61c-4c35b466f517 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.095902 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d4e15-45bc-44d7-b61c-4c35b466f517 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.096179 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d4e15-45bc-44d7-b61c-4c35b466f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.124405 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-534d4e15-45bc-44d7-b61c-4c35b466f517 None None] MFA Rules not processed for user `ab47be01ba8e4066b1b0e6ebf0532c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:40.125620 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-534d4e15-45bc-44d7-b61c-4c35b466f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:40.181837 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:40.191738 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1437/2870] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:40 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:40.224931 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:40.226675 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:40.285296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae155a68-a7a6-41a8-951f-4e853b27be4d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:40.289460 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0277-9437-4f09-a25a-aa543b8dceaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:40.290072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0277-9437-4f09-a25a-aa543b8dceaf service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.290354 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0277-9437-4f09-a25a-aa543b8dceaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.290631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0277-9437-4f09-a25a-aa543b8dceaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.298834 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0277-9437-4f09-a25a-aa543b8dceaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:40.300286 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0277-9437-4f09-a25a-aa543b8dceaf service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:40.308944 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1434/2871] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:40 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:40.323957 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d4e15-45bc-44d7-b61c-4c35b466f517 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:40.387422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d4e15-45bc-44d7-b61c-4c35b466f517 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:40.391895 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:40.392497 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.392774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.393045 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] PATH_INFO: `/v3/users/ab47be01ba8e4066b1b0e6ebf0532c16` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.394202 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab47be01ba8e4066b1b0e6ebf0532c16)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:40.396773 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:40.442880 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab47be01ba8e4066b1b0e6ebf0532c16'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:40.443554 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab47be01ba8e4066b1b0e6ebf0532c16'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:40.444157 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab47be01ba8e4066b1b0e6ebf0532c16'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:40.455842 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab47be01ba8e4066b1b0e6ebf0532c16'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:40.463479 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab47be01ba8e4066b1b0e6ebf0532c16'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:40.477783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1438/2872] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:25:40 2022] DELETE /identity/v3/users/ab47be01ba8e4066b1b0e6ebf0532c16 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:40.482282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.482568 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.482841 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.501617 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:40.502799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:40.562367 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1435/2873] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:40.572107 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:40.573534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:40.633113 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125d6ff-c14e-4736-8e00-b37d833b1497 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:40.636590 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf0966-00fa-4808-89f5-4979c29a1131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:40.637194 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0966-00fa-4808-89f5-4979c29a1131 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.637470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0966-00fa-4808-89f5-4979c29a1131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.637741 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0966-00fa-4808-89f5-4979c29a1131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.647545 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf0966-00fa-4808-89f5-4979c29a1131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:40.648969 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf0966-00fa-4808-89f5-4979c29a1131 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:40.658174 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1439/2874] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:40.924080 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:40.925541 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:40.937441 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4c43-7653-46cf-9e63-71ddc69be022 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:40.942600 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:40.943244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:40.943563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:40.943837 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] PATH_INFO: `/v3/projects/317feca5e0884101a1eb10c84c533971` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:40.945010 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=317feca5e0884101a1eb10c84c533971)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:40.946941 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:40.995189 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317feca5e0884101a1eb10c84c533971', 'request_id': 'req-bd22d439-79c3-4211-8c90-34bfac78de28'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:41.001977 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317feca5e0884101a1eb10c84c533971', 'request_id': 'req-bd22d439-79c3-4211-8c90-34bfac78de28'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:41.008674 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317feca5e0884101a1eb10c84c533971', 'request_id': 'req-bd22d439-79c3-4211-8c90-34bfac78de28'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:41.026345 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] The token cache is being invalidate because project 317feca5e0884101a1eb10c84c533971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:25:41.026631 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:41.027292 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-bd22d439-79c3-4211-8c90-34bfac78de28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:25:41.028810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1436/2875] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:25:40 2022] DELETE /identity/v3/projects/317feca5e0884101a1eb10c84c533971 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:25:41.033636 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5638fd-17f8-4565-9209-bb22338a0898 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.034119 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5638fd-17f8-4565-9209-bb22338a0898 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.034229 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5638fd-17f8-4565-9209-bb22338a0898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.054313 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-3c5638fd-17f8-4565-9209-bb22338a0898 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:41.055579 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-3c5638fd-17f8-4565-9209-bb22338a0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:41.069134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:41.117811 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1440/2876] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:41.125447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed374-81e8-4cf7-82a1-eda9e3e8fc4c None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.125735 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed374-81e8-4cf7-82a1-eda9e3e8fc4c None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.126009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed374-81e8-4cf7-82a1-eda9e3e8fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.146459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-7d5ed374-81e8-4cf7-82a1-eda9e3e8fc4c None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:41.147694 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7d5ed374-81e8-4cf7-82a1-eda9e3e8fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:41.155942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1437/2877] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:41.159984 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5638fd-17f8-4565-9209-bb22338a0898 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:41.170102 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5638fd-17f8-4565-9209-bb22338a0898 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:41.174751 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:41.175380 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.175662 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.176536 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.177341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:25:41.177644 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:41.179236 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:41.190538 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1441/2878] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:25:41.195889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ed374-81e8-4cf7-82a1-eda9e3e8fc4c None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:41.205130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ed374-81e8-4cf7-82a1-eda9e3e8fc4c None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:41.209956 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:41.210556 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.210838 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.211110 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.211816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:41.213763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:41.233618 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:41.243208 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1438/2879] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:25:41 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:25:41.247406 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:41.258307 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be450-bb8c-4587-8238-b346bfec5f2e admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:41.316184 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:41.317444 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.317724 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.318000 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.318686 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:41.320651 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:41.340970 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1442/2880] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:25:41 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:25:41.345296 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:41.356041 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4f219-a697-4f2d-a730-d98f40a29ffe admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:41.360855 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:41.361466 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.361748 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.362025 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.362725 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:41.365187 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:41.375061 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1439/2881] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:41.378868 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:41.389142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb40a99-41e3-43f7-8b88-4334fad76ce2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:41.393635 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360712-60e2-4c5f-b660-99543c06b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:41.394233 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360712-60e2-4c5f-b660-99543c06b174 admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.394513 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360712-60e2-4c5f-b660-99543c06b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.394983 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360712-60e2-4c5f-b660-99543c06b174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.395774 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360712-60e2-4c5f-b660-99543c06b174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:41.397356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360712-60e2-4c5f-b660-99543c06b174 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:41.407653 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1443/2882] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:25:41.412373 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:41.422200 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42b14-fc7a-410c-a4b7-447aa088fadb admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:41.427344 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:41.427988 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.428270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.428544 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] PATH_INFO: `/v3/projects/b64059a888eb40a4bba43d9a0ff30777/users/edb879d2972246dc8d137ee723a96ad9/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.443161 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64059a888eb40a4bba43d9a0ff30777, user_id=edb879d2972246dc8d137ee723a96ad9, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:41.445892 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:41.459485 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1440/2883] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:25:41 2022] PUT /identity/v3/projects/b64059a888eb40a4bba43d9a0ff30777/users/edb879d2972246dc8d137ee723a96ad9/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:25:41.526475 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20086ce8-08e7-4d44-a8fc-bbd27c6db4f5 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.526763 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20086ce8-08e7-4d44-a8fc-bbd27c6db4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.527039 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20086ce8-08e7-4d44-a8fc-bbd27c6db4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.556542 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-20086ce8-08e7-4d44-a8fc-bbd27c6db4f5 None None] MFA Rules not processed for user `edb879d2972246dc8d137ee723a96ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:25:41.557744 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-20086ce8-08e7-4d44-a8fc-bbd27c6db4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:41.624038 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1444/2884] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:25:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:25:41.635370 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:25:41.637075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:25:41.693766 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783b4cf-0d18-4ea4-b1a7-e25518aaa9dd admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:25:41.697357 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498ba3-9747-45ef-b744-031638b62b68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2d3a3a7c1f545e593e7956ec79f25ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:25:41.697970 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498ba3-9747-45ef-b744-031638b62b68 service glance] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:25:41.698283 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498ba3-9747-45ef-b744-031638b62b68 service glance] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:25:41.698561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498ba3-9747-45ef-b744-031638b62b68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:25:41.706828 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498ba3-9747-45ef-b744-031638b62b68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:25:41.708293 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498ba3-9747-45ef-b744-031638b62b68 service glance] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:25:41.716905 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1441/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:25:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:25:51.621137 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:25:51.712975 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:04.502292 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20086ce8-08e7-4d44-a8fc-bbd27c6db4f5 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:04.570678 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20086ce8-08e7-4d44-a8fc-bbd27c6db4f5 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:04.575221 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:04.575894 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:04.576177 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:04.576455 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] PATH_INFO: `/v3/users/edb879d2972246dc8d137ee723a96ad9` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:04.577750 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb879d2972246dc8d137ee723a96ad9)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:04.579723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:04.631023 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb879d2972246dc8d137ee723a96ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:04.631704 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb879d2972246dc8d137ee723a96ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:04.632317 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb879d2972246dc8d137ee723a96ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:04.646327 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb879d2972246dc8d137ee723a96ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:04.654964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb879d2972246dc8d137ee723a96ad9'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:04.671782 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1445/2886] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:26:04 2022] DELETE /identity/v3/users/edb879d2972246dc8d137ee723a96ad9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:26:04.677107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:04.677581 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:04.677670 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:04.698206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:26:04.699447 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:04.758561 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1442/2887] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:26:04.768519 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:04.769921 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:04.827087 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6fb67-fe2a-4b61-91a0-7bc9c238e0f2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:04.830723 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8dc14-6bd1-4fbb-9313-dc610f4ace33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:04.831556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8dc14-6bd1-4fbb-9313-dc610f4ace33 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:04.831840 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8dc14-6bd1-4fbb-9313-dc610f4ace33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:04.832116 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8dc14-6bd1-4fbb-9313-dc610f4ace33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:04.840942 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8dc14-6bd1-4fbb-9313-dc610f4ace33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:04.842639 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8dc14-6bd1-4fbb-9313-dc610f4ace33 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:04.852783 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1446/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:26:05.124294 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.125685 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:05.140805 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eb4c3-bc17-4896-b26f-d859c4b10d7f None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.147498 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.148157 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.148424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.148708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] PATH_INFO: `/v3/projects/b64059a888eb40a4bba43d9a0ff30777` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.149890 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64059a888eb40a4bba43d9a0ff30777)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.151860 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.198031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64059a888eb40a4bba43d9a0ff30777', 'request_id': 'req-329b8f50-c60d-4ee7-9a61-831c72dda44a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:05.204733 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64059a888eb40a4bba43d9a0ff30777', 'request_id': 'req-329b8f50-c60d-4ee7-9a61-831c72dda44a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:05.211013 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64059a888eb40a4bba43d9a0ff30777', 'request_id': 'req-329b8f50-c60d-4ee7-9a61-831c72dda44a'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:05.223015 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] The token cache is being invalidate because project b64059a888eb40a4bba43d9a0ff30777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:26:05.223332 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:05.223971 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-329b8f50-c60d-4ee7-9a61-831c72dda44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:05.225523 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1443/2889] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:26:05 2022] DELETE /identity/v3/projects/b64059a888eb40a4bba43d9a0ff30777 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:26:05.230550 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622db1-e9ff-466a-9668-3959c781fa24 None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.230829 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622db1-e9ff-466a-9668-3959c781fa24 None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.231134 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622db1-e9ff-466a-9668-3959c781fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.250247 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-30622db1-e9ff-466a-9668-3959c781fa24 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:26:05.251489 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-30622db1-e9ff-466a-9668-3959c781fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:05.268282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:05.311737 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1447/2890] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:26:05.319966 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c8be-1cd8-4aaf-971d-e66b6cbd7fea None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.320255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c8be-1cd8-4aaf-971d-e66b6cbd7fea None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.320528 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c8be-1cd8-4aaf-971d-e66b6cbd7fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.340736 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-bd99c8be-1cd8-4aaf-971d-e66b6cbd7fea None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:26:05.342249 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-bd99c8be-1cd8-4aaf-971d-e66b6cbd7fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:05.350708 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1444/2891] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:26:05.354968 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622db1-e9ff-466a-9668-3959c781fa24 None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.364492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622db1-e9ff-466a-9668-3959c781fa24 None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.369083 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.369681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.369964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.370239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.370927 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 04:26:05.371230 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.372888 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.384792 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1448/2892] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 04:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 04:26:05.389276 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99c8be-1cd8-4aaf-971d-e66b6cbd7fea None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.399371 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99c8be-1cd8-4aaf-971d-e66b6cbd7fea None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.404005 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.404610 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.404896 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.405177 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.405854 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.407846 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.436423 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1445/2893] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 04:26:05 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 04:26:05.441090 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.450964 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0ae9-58ef-461e-a467-3b11d2e351bd admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.506289 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.506960 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.507169 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.507486 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.508131 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.510051 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.531611 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1449/2894] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 04:26:05 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 04:26:05.535920 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.545942 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc77fdf-1347-4139-8159-f2e856ad6d3b admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.550684 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.551303 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.551586 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.551859 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.552546 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.554137 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.563909 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1446/2895] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 04:26:05.568504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.578470 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faca71-d8e9-4106-ae46-523cb4266dd2 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.584001 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da337f0-30de-493e-847d-f91a1d6b107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.584606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da337f0-30de-493e-847d-f91a1d6b107a admin admin] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.584892 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da337f0-30de-493e-847d-f91a1d6b107a admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.585170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da337f0-30de-493e-847d-f91a1d6b107a admin admin] PATH_INFO: `/v3/roles` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.585861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da337f0-30de-493e-847d-f91a1d6b107a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.587794 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da337f0-30de-493e-847d-f91a1d6b107a admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.599356 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1450/2896] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 04:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 04:26:05.603598 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.614072 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97b4b0-0d9e-4ec7-b139-455a97b88714 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.619060 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.619817 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.620149 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.620380 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] PATH_INFO: `/v3/projects/76de9e505f02477582c9e3e486070234/users/4be5ed094b4141fa8fe64b5d63ff9482/roles/754e311d9d2c401189da910d6d3bfe01` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.635191 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76de9e505f02477582c9e3e486070234, user_id=4be5ed094b4141fa8fe64b5d63ff9482, role_id=754e311d9d2c401189da910d6d3bfe01)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.637900 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.650660 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1447/2897] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 04:26:05 2022] PUT /identity/v3/projects/76de9e505f02477582c9e3e486070234/users/4be5ed094b4141fa8fe64b5d63ff9482/roles/754e311d9d2c401189da910d6d3bfe01 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 04:26:05.662305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bb07-4afc-4498-a657-2d151744eacd None None] REQUEST_METHOD: `POST` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.662595 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bb07-4afc-4498-a657-2d151744eacd None None] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.662872 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bb07-4afc-4498-a657-2d151744eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.691024 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.auth.core [None req-6ec6bb07-4afc-4498-a657-2d151744eacd None None] MFA Rules not processed for user `4be5ed094b4141fa8fe64b5d63ff9482`. Rule list: `[]` (Enabled: `True`). {{(pid=80351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:26:05.692286 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-6ec6bb07-4afc-4498-a657-2d151744eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:05.756976 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1451/2898] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:26:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 04:26:05.768193 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:05.770230 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:05.793510 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:05.831763 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ecd3b-8090-4c3f-974b-c26ab7fa8011 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:05.835459 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bf027-5c50-4478-8ea6-94d0ff102d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046b235e211744b0bfe631e0acf4d6e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:05.836076 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bf027-5c50-4478-8ea6-94d0ff102d05 service cinder] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:05.836359 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bf027-5c50-4478-8ea6-94d0ff102d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:05.836634 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bf027-5c50-4478-8ea6-94d0ff102d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:05.845130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bf027-5c50-4478-8ea6-94d0ff102d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:05.846589 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bf027-5c50-4478-8ea6-94d0ff102d05 service cinder] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:05.855337 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1448/2899] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:26:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:26:15.753239 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:15.851333 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=17 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:35.776463 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6bb07-4afc-4498-a657-2d151744eacd None None] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:35.880008 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6bb07-4afc-4498-a657-2d151744eacd None None] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:35.884525 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:35.885153 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:35.885433 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:35.885707 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] PATH_INFO: `/v3/users/4be5ed094b4141fa8fe64b5d63ff9482` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:35.886862 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be5ed094b4141fa8fe64b5d63ff9482)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:35.888808 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:35.933225 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be5ed094b4141fa8fe64b5d63ff9482'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:35.933901 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be5ed094b4141fa8fe64b5d63ff9482'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:35.934504 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be5ed094b4141fa8fe64b5d63ff9482'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:35.946534 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be5ed094b4141fa8fe64b5d63ff9482'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:35.953581 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be5ed094b4141fa8fe64b5d63ff9482'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:35.967019 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1452/2900] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:26:35 2022] DELETE /identity/v3/users/4be5ed094b4141fa8fe64b5d63ff9482 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:26:35.971559 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] REQUEST_METHOD: `POST` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:35.972039 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:35.972166 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:36.024711 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.auth.core [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] MFA Rules not processed for user `7081d973c3644a09a5c8eaa060094b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 04:26:36.025913 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:36.082793 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1449/2901] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 04:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 04:26:36.093400 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:36.094856 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:36.136492 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:36.189576 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade387c9-ff9e-4890-81b1-26520d510969 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:36.193171 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:36.193778 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:36.194059 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:36.194336 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:36.203821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:36.205262 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:36.215606 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1453/2902] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:26:36.477360 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:26:36.478788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:26:36.490732 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea155a06-343c-46a9-9265-b6437d9d2b54 None None] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:26:36.496467 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:26:36.497107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:26:36.497388 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:26:36.497664 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] PATH_INFO: `/v3/projects/76de9e505f02477582c9e3e486070234` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:26:36.498816 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76de9e505f02477582c9e3e486070234)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:26:36.500810 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:26:36.549703 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76de9e505f02477582c9e3e486070234', 'request_id': 'req-20224849-57a3-4410-934c-74f9db64dd1d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:36.557376 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76de9e505f02477582c9e3e486070234', 'request_id': 'req-20224849-57a3-4410-934c-74f9db64dd1d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:36.563107 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76de9e505f02477582c9e3e486070234', 'request_id': 'req-20224849-57a3-4410-934c-74f9db64dd1d'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:36.574629 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] The token cache is being invalidate because project 76de9e505f02477582c9e3e486070234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:26:36.574919 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:36.575578 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:26:36.577081 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1450/2903] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:26:36 2022] DELETE /identity/v3/projects/76de9e505f02477582c9e3e486070234 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:26:46.210422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=25 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:26:46.571031 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:27:20.662341 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:27:20.663826 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:27:20.754490 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a43d5-221b-4df3-812b-6f20edc7037a service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:27:20.815572 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:27:20.816187 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:27:20.816467 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:27:20.816769 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:27:20.818510 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:27:20.830108 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:27:20.831729 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:27:20.841940 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1454/2904] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:27:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:27:30.837399 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=67 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:10.573880 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:10.575676 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:10.650273 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224849-57a3-4410-934c-74f9db64dd1d admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:10.655572 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:10.656571 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:10.656994 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:10.657419 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:10.659398 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:10.673209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:10.674844 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:10.685599 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1451/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:29:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:29:10.703318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:10.705423 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:10.719181 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d610f-2ca1-44b4-ae19-a67703d4ec42 service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:10.729419 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:10.730243 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:10.730476 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:10.730753 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:10.732559 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:10.827283 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:10.828835 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:10.849607 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1455/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:29:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:29:12.091130 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:12.100270 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedd9d9-10d5-47b8-b8ee-510acb606046 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:12.104622 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90c842029d845bd8b4f12696354af78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:12.105338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:12.105687 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:12.106029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:12.107889 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:12.122655 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:12.124040 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:12.136135 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1452/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:29:12.672170 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:12.673681 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:12.688355 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbe69-fcdd-4297-963a-d82af855ca42 service neutron] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:12.694352 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ebb13ad8c483fa715e5f6906b05f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:12.694973 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:12.695255 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:12.696210 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:12.698062 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:12.711924 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:12.713857 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:12.727459 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1456/2908] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:29:16.690255 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:16.692211 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:16.707486 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb17d0-b52a-4eff-999a-c53fea59bf93 service neutron] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:16.719869 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:16.720512 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:16.720799 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:16.721075 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:16.723058 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:16.736206 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:16.737827 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:16.749620 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1453/2909] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:29:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 04:29:19.872602 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:19.886821 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579dc53-ddcd-4cc9-9ea0-38938240d3a4 service nova] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:19.897196 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:19.898044 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] REQUEST_METHOD: `GET` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:19.898136 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:19.898460 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:19.902178 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:19.914798 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:19.917693 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:19.935601 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1457/2910] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:29:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:29:19.939864 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:19.941433 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:20.012212 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455396-8294-4dc5-99f6-9b55d2c846ac service placement] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:20.016969 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:20.017651 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:20.017937 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:20.018244 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] PATH_INFO: `/v3/users/84909a4d4cb94f40a0e4b79e1e45e3d2` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:20.019502 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=84909a4d4cb94f40a0e4b79e1e45e3d2)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:20.021463 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:20.068262 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84909a4d4cb94f40a0e4b79e1e45e3d2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.076396 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84909a4d4cb94f40a0e4b79e1e45e3d2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.083282 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84909a4d4cb94f40a0e4b79e1e45e3d2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.083956 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84909a4d4cb94f40a0e4b79e1e45e3d2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.084563 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84909a4d4cb94f40a0e4b79e1e45e3d2'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.096491 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:20.104583 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1454/2911] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:29:19 2022] DELETE /identity/v3/users/84909a4d4cb94f40a0e4b79e1e45e3d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:29:20.279556 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:20.292978 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490315cf-346b-4114-9269-e1eea9ab0db4 service placement] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:20.350420 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:20.351057 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:20.351369 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:20.351650 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] PATH_INFO: `/v3/projects/900f36ef67d04c1ab196c252f1bda103` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:20.352800 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=900f36ef67d04c1ab196c252f1bda103)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:20.355282 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:20.392890 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:20.402945 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900f36ef67d04c1ab196c252f1bda103', 'request_id': 'req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.408280 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900f36ef67d04c1ab196c252f1bda103', 'request_id': 'req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.416126 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900f36ef67d04c1ab196c252f1bda103', 'request_id': 'req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.426913 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] The token cache is being invalidate because project 900f36ef67d04c1ab196c252f1bda103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:29:20.427205 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.427855 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.429350 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1458/2912] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:29:20 2022] DELETE /identity/v3/projects/900f36ef67d04c1ab196c252f1bda103 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:29:20.434696 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:20.436202 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:20.449182 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae054613-166e-4bed-ba4f-2a068f15fcac admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:20.506085 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:20.506724 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:20.507009 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:20.507312 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] PATH_INFO: `/v3/users/9cc673324d734683b0126025cac2464f` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:20.508480 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc673324d734683b0126025cac2464f)` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:20.510415 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:20.553978 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc673324d734683b0126025cac2464f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.561776 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc673324d734683b0126025cac2464f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.568788 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc673324d734683b0126025cac2464f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.569411 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc673324d734683b0126025cac2464f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.570008 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.notifications [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc673324d734683b0126025cac2464f'} {{(pid=80352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.588209 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1455/2913] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 04:29:20 2022] DELETE /identity/v3/users/9cc673324d734683b0126025cac2464f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:29:20.763861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Authenticating user token {{(pid=80351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:29:20.765318 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.fernet_utils [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:29:20.783529 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a3b1-a9d0-4be1-9143-40ab39f2a560 admin admin] Validating token access rules against request {{(pid=80351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:29:20.840500 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081d973c3644a09a5c8eaa060094b63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe087670259b408d800e85991f04fa29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:29:20.841142 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:29:20.841422 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:29:20.841699 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] PATH_INFO: `/v3/projects/1f82b7d21cfc403e92fbc193cdcbe391` {{(pid=80351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:29:20.842851 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f82b7d21cfc403e92fbc193cdcbe391)` {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:29:20.844836 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] RBAC: Authorization granted {{(pid=80351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:29:20.892935 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f82b7d21cfc403e92fbc193cdcbe391', 'request_id': 'req-f5da9042-59b4-4a50-964d-4ed7829c02f5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.898308 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f82b7d21cfc403e92fbc193cdcbe391', 'request_id': 'req-f5da9042-59b4-4a50-964d-4ed7829c02f5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.905784 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f82b7d21cfc403e92fbc193cdcbe391', 'request_id': 'req-f5da9042-59b4-4a50-964d-4ed7829c02f5'} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.917383 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] The token cache is being invalidate because project 1f82b7d21cfc403e92fbc193cdcbe391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 04:29:20.917674 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.918305 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG keystone.notifications [None req-f5da9042-59b4-4a50-964d-4ed7829c02f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 04:29:20.919861 dv-cinder-850989-2-smb devstack@keystone.service[80351]: [pid: 80351|app: 0|req: 1459/2914] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 04:29:20 2022] DELETE /identity/v3/projects/1f82b7d21cfc403e92fbc193cdcbe391 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 04:29:30.584424 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:29:30.913850 dv-cinder-850989-2-smb devstack@keystone.service[80351]: DEBUG dbcounter [-] [80351] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=80351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 04:32:25.624059 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Authenticating user token {{(pid=80352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 04:32:25.625515 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:32:25.694781 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22feae-3dcf-4d85-a461-3ed03b772628 admin admin] Validating token access rules against request {{(pid=80352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 04:32:25.754387 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a675b0e-23b2-42aa-b483-a8ca507fb688 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e9ac125aab4b6bb623a02add505b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44741ed50614da19d28eab38b8c9330', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 04:32:25.755029 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a675b0e-23b2-42aa-b483-a8ca507fb688 service placement] REQUEST_METHOD: `GET` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 04:32:25.755338 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a675b0e-23b2-42aa-b483-a8ca507fb688 service placement] SCRIPT_NAME: `/identity` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 04:32:25.755615 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a675b0e-23b2-42aa-b483-a8ca507fb688 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 04:32:25.757355 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.fernet_utils [None req-6a675b0e-23b2-42aa-b483-a8ca507fb688 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 04:32:25.768881 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a675b0e-23b2-42aa-b483-a8ca507fb688 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 04:32:25.770436 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a675b0e-23b2-42aa-b483-a8ca507fb688 service placement] RBAC: Authorization granted {{(pid=80352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 04:32:25.780134 dv-cinder-850989-2-smb devstack@keystone.service[80352]: [pid: 80352|app: 0|req: 1456/2915] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 04:32:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 04:32:35.775914 dv-cinder-850989-2-smb devstack@keystone.service[80352]: DEBUG dbcounter [-] [80352] Writing DB stats keystone:SELECT=58 {{(pid=80352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}